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Preface 


The book is primarily intended for instruction in an upper-level undergraduate 
or a first-year graduate course in the field of signal processing in electrical 
and computer engineering. Practising engineers would find the book useful 
for reference or for self study. Our main motivation in writing the book is to 
deal with continuous-time (CT) and discrete-time (DT) signals and systems 
separately. Many instructors have realized that covering CT and DT systems in 
parallel with each other often confuses students to the extent where they are not 
clear if a particular concept applies to a CT system, to a DT system, or to both. 
In this book, we treat DT and CT signals and systems separately. Following 
Part I, which provides an introduction to signals and systems. Part II focuses on 
CT signals and systems. Since most students are familiar with the theory of CT 
signals and systems from earlier courses. Part II can be taught to such students 
with relative ease. For students who are new to this area, we have supplemented 
the material covered in Part II with appendices, which are included at the end 
of the book. Appendices A-F cover background material on complex numbers, 
partial fraction expansion, differential equations, difference equations, and a 
review of the basic signal processing instructions available in Matlab. Part 
III, which covers DT signals and systems, can either be covered independently 
or in conjunction with Part II. 

The book focuses on linear time-invariant (LTI) systems and is organized as 
follows. Chapters 1 and 2 introduce signals and systems, including their math- 
ematical and graphical interpretations. In Chapter 1 , we cover the classification 
between CT and DT signals and we provide several practical examples in which 
CT and DT signals are observed. Chapter 2 defines systems as transformations 
that process the input signals and produce outputs in response to the applied 
inputs. Practical examples of CT and DT systems are included in Chapter 2. 
The remaining fifteen chapters of the book are divided into two parts. Part 
II constitutes Chapters 3-8 of the book and focuses primarily on the theories 
and applications of CT signals and systems. Part III comprises Chapters 9-17 
and deals with the theories and applications of DT signals and systems. The 
organization of Parts II and III is described below. 
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Chapter 3 introduces the time-domain analysis of the linear time-invariant 
continuous-time (LTIC) systems, including the convolution integral used to 
evaluate the output in response to a given input signal. Chapter 4 defines the 
continuous-time Fourier series (CTFS) as a frequency representation for the 
CT periodic signals, and Chapter 5 generalizes the CTFS to aperiodic signals 
and develops an alternative representation, referred to as the continuous-time 
Fourier transform (CTFT). Not only do the CTFT and CTFS representations 
provide an alternative to the convolution integral for the evaluation of the out- 
put response, but also these frequency representations allow additional insights 
into the behavior of the LTIC systems that are exploited later in the book to 
design such systems. While the CTFT is useful for steady state analysis of 
the LTIC systems, the Laplace transform, introduced in Chapter 6, is used in 
control applications where transient and stability analyses are required. An 
important subset of LTIC systems are frequency-selective filters, whose char- 
acteristics are specified in the frequency domain. Chapter 7 presents design 
techniques for several CT frequency-selective filters including the Butterworth, 
Chebyshev, and elliptic filters. Finally, Chapter 8 concludes our treatment of 
LTIC signals and systems by reviewing important applications of CT signal 
processing. 

The coverage of CT signals and systems concludes with Chapter 8 and a 
course emphasizing the CT domain can be completed at this stage. In Part 
III, Chapter 9 starts our consideration of DT signals and systems by providing 
several practical examples in which such signals are observed directly. Most 
DT sequences are, however, obtained by sampling CT signals. Chapter 9 shows 
how a band-limited CT signal can be accurately represented by a DT sequence 
such that no information is lost in the conversion from the CT to the DT domain. 
Chapter 10 provides the time-domain analysis of linear time-invariant discrete- 
time (LTID) systems, including the convolution sum used to calculate the 
output of a DT system. Chapter 1 1 introduces the frequency representations for 
DT sequences, namely the discrete-time Fourier series (DTFS) and the discrete- 
time Fourier transform (DTFT). The discrete Fourier transform (DFT) samples 
the DTFT representation in the frequency domain and is convenient for digital 
signal processing of finite-length sequences. Chapter 12 introduces the DFT, 
while Chapter 13 is devoted to a discussion of the z-transform. As for CT sys- 
tems, DT systems are generally specified in the frequency domain. A particular 
class of DT systems, referred to as frequency-selective digital filters, is intro- 
duced in Chapter 14. Based on the length of the impulse response, digital filters 
can be further classified into finite impulse response (FIR) and infinite impulse 
response (HR) filters. Chapter 15 covers the design techniques for the HR filters, 
and Chapter 16 presents the design techniques for the HR filters. Chapter 17 
concludes the book by motivating the students with several applications of 
digital signal processing in audio and music, spectral analysis, and image and 
video processing. 

Although the book has been designed to be as self-contained as possible, 
some basic prerequisites have been assumed. For example, an introductory 
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background in mathematics which includes trigonometry, differential calculus, 
integral calculus, and complex number theory, would be helpful. A course in 
electrical circuits, although not essential, would be highly useful as several 
examples of electrical circuits have been used as systems to motivate the 
students. For students who lack some of the required background information, 
a review of the core background materials such as complex numbers, partial 
fraction expansion, differential equations, and difference equations is provided 
in the appendices. 

The normal use of this book should be as follows. For a first course in signal 
processing, at, say, sophomore or junior level, a reasonable goal is to teach 
Part II, covering continuous-time (CT) signals and sysems. Part III provides the 
material for a more advanced course in discrete-time (DT) signal processing. We 
have also spent a great deal of time experimening with different presentations for 
a single-semester signals and systems course. Typically, such a course should 
include Chapters 1, 2, 3, 10, 4, 5, 11, 6, and 13 in that order. Below, we provide 
course outlines for a few traditional signal processing courses. These course 
outlines should be useful to an instructor teaching this type of material or using 
the book for the first time. 

(1) Continuous-time signals and systems: Chapters 1-8. 

(2) Discrete-time signals and systems: Chapters 1, 2, 9-17. 

(3) Traditional signals and systems: Chapters 1, 2, (3, 10), (4, 5, 11), 6, 13. 

(4) Digital signal processing: Chapters 10-17. 

(5) Transform theory: Chapters (4, 5, 1 1), 6, 13. 

Another useful feature of the book is that the chapters are self-contained so that 
they may be taught independently of each other. There is a significant difference 
between reading a book and being able to apply the material to solve actual 
problems of interest. An effective use of the book must include a fair coverage 
of the solved examples and problem solving by motivating the students to solve 
the problems included at the end of each chapter. As such, a major focus of 
the book is to illustrate the basic signal processing concepts with examples. 
We have included 287 worked examples, 409 supplementary problems at the 
ends of the chapters, and more than 300 figures to explain the important con- 
cepts. Wherever relevant, we have extensively used Matlab to validate our 
analytical results and also to illustrate the design procedures for a variety of 
problems. In most cases, the Matlab code is provided in the accompanying 
CD, so the students can readily run the code to satisfy their curiosity. To further 
enhance their understanding of the main signal processing concepts, students 
are encouraged to program extensively in Matlab. Consequently, several 
Matlab exercises have been included in the Problems sections. 

Any suggestions or concerns regarding the book may be communicated 
to the authors; email addresses are listed at http://www.cambridge.org/ 
9780521854559. Future updates on the book will also be available at the same 
website. 
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Introduction to signals and systems 





CHAPTER 


Introduction to signals 


Signals are detectable quantities used to convey information about time-varying 
physical phenomena. Common examples of signals are human speech, temper- 
ature, pressure, and stock prices. Electrical signals, normally expressed in the 
form of voltage or current waveforms, are some of the easiest signals to generate 
and process. 

Mathematically, signals are modeled as functions of one or more independent 
variables. Examples of independent variables used to represent signals are time, 
frequency, or spatial coordinates. Before introducing the mathematical notation 
used to represent signals, let us consider a few physical systems associated 
with the generation of signals. Figure 1 . 1 illustrates some common signals and 
systems encountered in different fields of engineering, with the physical sys- 
tems represented in the left-hand column and the associated signals included in 
the right-hand column. Figure 1.1(a) is a simple electrical circuit consisting of 
three passive components: a capacitor C, an inductor L, and a resistor R. A 
voltage v(f) is applied at the input of the RLC circuit, which produces an output 
voltage y(t) across the capacitor. A possible waveform for y(t) is the sinusoidal 
signal shown in Fig. 1 .1(b). The notations v(t) and y(t) includes both the depen- 
dent variable, v and y , respectively, in the two expressions, and the independent 
variable t. The notation v(t) implies that the voltage v is a function of time t . 
Figure 1.1(c) shows an audio recording system where the input signal is an audio 
or a speech waveform. The function of the audio recording system is to convert 
the audio signal into an electrical waveform, which is recorded on a magnetic 
tape or a compact disc. A possible resulting waveform for the recorded electri- 
cal signal is shown in Fig 1.1(d). Figure 1.1(e) shows a charge coupled device 
(CCD) based digital camera where the input signal is the light emitted from a 
scene. The incident light charges a CCD panel located inside the camera, thereby 
storing the external scene in terms of the spatial variations of the charges on the 
CCD panel. Figure 1.1(g) illustrates a thermometer that measures the ambient 
temperature of its environment. Electronic thermometers typically use a thermal 
resistor, known as a thermistor, whose resistance varies with temperature. The 
fluctuations in the resistance are used to measure the temperature. Figure 1.1(h) 
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Fig. 1.1. Examples of signals and systems, (a) An electrical circuit; (c) an audio recording system; (e) a 
digital camera; and (g) a digital thermometer. Plots (b), (d), (f), and (h) are output signals generated, 
respectively, by the systems shown in (a), (c), (e), and (g). 
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input _ 
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Fig. 1.2. Processing of a signal 
by a system. 


plots the readings of the thermometer as a function of discrete time. In the 
aforementioned examples of Fig. 1.1, the RLC circuit, audio recorder, CCD 
camera, and thermometer represent different systems, while the information- 
bearing waveforms, such as the voltage, audio, charges, and fluctuations in 
resistance, represent signals. The output waveforms, for example the voltage in 
the case of the electrical circuit, current for the microphone, and the fluctuations 
in the resistance for the thermometer, vary with respect to only one variable 
(time) and are classified as one-dimensional (ID) signals. On the other hand, 
the charge distribution in the CCD panel of the camera varies spatially in two 
dimensions. The independent variables are the two spatial coordinates ( m , n). 
The charge distribution signal is therefore classified as a two-dimensional (2D) 
signal. 

The examples shown in Fig. 1 . 1 illustrate that typically every system has one 
or more signals associated with it. A system is therefore defined as an entity 
that processes a set of signals (called the input signals) and produces another 
set of signals (called the output signals). The voltage source in Fig. 1.1(a), 
the sound in Fig. 1.1(c), the light entering the camera in Fig. 1.1(e), and the 
ambient heat in Fig. 1.1(g) provide examples of the input signals. The voltage 
across capacitor C in Fig. 1.1(b), the voltage generated by the microphone in 
Fig. 1.1(d), the charge stored on the CCD panel of the digital camera, displayed 
as an image in Fig. 1.1(f), and the voltage generated by the thermistor, used to 
measure the room temperature, in Fig. 1.1(h) are examples of output signals. 

Figure 1.2 shows a simplified schematic representation of a signal processing 
system. The system shown processes an input signal x(t) producing an output 
y{t). This model may be used to represent a range of physical processes includ- 
ing electrical circuits, mechanical devices, hydraulic systems, and computer 
algorithms with a single input and a single output. More complex systems have 
multiple inputs and multiple outputs (MIMO). 

Despite the wide scope of signals and systems, there is a set of fundamental 
principles that control the operation of these systems. Understanding these basic 
principles is important in order to analyze, design, and develop new systems. 
The main focus of the text is to present the theories and principles used in 
signals and systems. To keep the presentations simple, we focus primarily on 
signals with one independent variable (usually the time variable denoted by t 
or k), and systems with a single input and a single output. The theories that we 
develop for single-input, single-output systems are, however, generalizable to 
multidimensional signals and systems with multiple inputs and outputs. 


1.1 Classification of signals 


A signal is classified into several categories depending upon the criteria used 
for its classification. In this section, we cover the following categories for 
signals: 
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(i) continuous-time and discrete-time signals; 

(ii) analog and digital signals; 

(iii) periodic and aperiodic (or nonperiodic) signals; 

(iv) energy and power signals; 

(v) deterministic and probabilistic signals; 

(vi) even and odd signals. 


1.1.1 Continuous-time and discrete-time signals 

If a signal is defined for all values of the independent variable t, it is called 
a continuous-time (CT) signal. Consider the signals shown in Figs. 1.1(b) and 
(d). Since these signals vary continuously with time t and have known mag- 
nitudes for all time instants, they are classified as CT signals. On the other 
hand, if a signal is defined only at discrete values of time, it is called a discrete- 
time (DT) signal. Figure 1.1(h) shows the output temperature of a room mea- 
sured at the same hour every day for one week. No information is available 
for the temperature in between the daily readings. Figure 1.1(h) is therefore 
an example of a DT signal. In our notation, a CT signal is denoted by x(t) 
with regular parenthesis, and a DT signal is denoted with square parenthesis as 
follows: 


x[kT], k = 0, ±1, ±2, ±3, . . . , 


Fig. 1.5. (a) CT sinusoidal signal 
x(t) spedfied in Example 1.1; 

(b) DT sinusoidal signal x [/r] 
obtained by discretizing x(t) 
with a sampling interval 
T = 0.25 s. 


where T denotes the time interval between two consecutive samples. In the 
example of Fig. 1.1(h), the value of T is one day. To keep the notation simple, 
we denote a one-dimensional (ID) DT signal x by x[k]. Though the sampling 
interval is not explicitly included in x[k], it will be incorporated if and when 
required. 

Note that all DT signals are not functions of time. Figure 1.1(f), for example, 
shows the output of a CCD camera, where the discrete output varies spatially in 
two dimensions. Here, the independent variables are denoted by ( m , n), where 
m and n are the discretized horizontal and vertical coordinates of the picture 
element. In this case, the two-dimensional (2D) DT signal representing the 
spatial charge is denoted by x[m,n]. 



(a) 


(b) 
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Example 1.1 

Consider the CT signal x(t) = sin(jrf) plotted in Fig. 1.3(a) as a function of 
time t. Discretize the signal using a sampling interval of T = 0.25 s, and sketch 
the waveform of the resulting DT sequence for the range —8 < A < 8. 


Solution 

By substituting t = kT , the DT representation of the CT signal x(t) is given by 
x[AT] = sin(7rA x T) = sin(0.257rA). 

For A = 0, ±1, ±2, . . . , the DT signal x[k] has the following values: 


jc[ — 8] = a(— 8 T) = sin(— 2tz) = 0, 

1 

*[-7] = x{—lT) = sin(— 1.75 jt) = — , 

V2 

jc [ — 6] = x(—6 T) = sin(— 1.5 jt) = 1, 

1 

jc[ — 5] = x(—5 T) = sin(— 1.25 jt) = — 

v/2 


*[1] = x{T ) = sin(0.257r) = — — , 

V2 

x\2] = x(2 T) = sin(0.57r) = 1, 

1 

x[3] = x(3 T) = sin(0.75jr) = — , 

V2 

x[4] = x(4 T) = sin(7r) = 0, 


jc [ — 4] = jc( — 4r ) = sin(— n) = 0, 


jr[5] = x(5T) = sin(1.257r) = — , 

V2 


jc[ — 3] = x(—3T) = sin(— 0.75 jt) = r=, x[6] = x(6T) = sin(1.5;r) = — 1, 

s[2 


jc[— 2] = jc(— 2 T) = sin(— 0.5 jt) = -1, 


1 


jc[7] = x(lT) = sin(1.757r) = 

V2 


jc [ — 1] = x(—T) = sin(— 0.25 jt) = — , a' [8] = jc(8 T) = sin(2^) = 0, 

a/2 

a [0] = x(0) = sin(0) = 0. 


Plotted as a function of A, the waveform for the DT signal a [A] is shown in 
Fig. 1.3(b), where for reference the original CT waveform is plotted with a 
dotted line. We will refer to a DT plot illustrated in Fig. 1.3(b) as a bar or a 
stem plot to distinguish it from the CT plot of x(t), which will be referred to as 
a line plot. 


Example 1.2 

Consider the rectangular pulse plotted in Fig. 1 .4. Mathematically, the rectan- 
gular pulse is denoted by 


1 

x(t) 





- — ► 


-0.5t 0.5t t 


Fig. 1.4. Waveform for CT 
rectangular function. It may be 
noted that the rectangular 
function is discontinuous at 
f = ±r/2. 


x(t) = rect 



1 \t\ < t/2 

0 |f| > r/2. 


From the waveform in Fig. 1.4, it is clear that x(t) is continuous in time but 
has discontinuities in magnitude at time instants t = ±0.5r. At t = 0.5r, for 
example, the rectangular pulse has two values: 0 and 1 . A possible way to avoid 
this ambiguity in specifying the magnitude is to state the values of the signal x(t) 
at t = 0.5r ~ and t = 0.5r + , i.e. immediately before and after the discontinuity. 
Mathematically, the time instant t = 0.5r _ is defined as t = 0.5r — e, where 
e is an infinitely small positive number that is close to zero. Similarly, the 
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time instant t — 0.5r + is defined as t = 0.5r + s. The value of the rectangular 
pulse at the discontinuity t = 0.5r is, therefore, specified by a(0.5t~) = 1 
and .v(0.5r + ) = 0. Likewise, the value of the rectangular pulse at its other 
discontinuity t = — 0.5r is specified by x(— 0.5r _ ) = 0 and x{— 0.5r + ) = 1. 

A CT signal that is continuous for all t except for a finite number of instants 
is referred to as a piecewise CT signal. The value of a piecewise CT signal at the 
point of discontinuity t\ can either be specified by our earlier notation, described 
in the previous paragraph, or, alternatively, using the following relationship: 

x{h) = 0.5 [*(*+) + jc(ff)]. (1.1) 

Equation (1.1) shows that x(±0.5r) = 0.5 at the points of discontinuity t = 
±0.5r. The second approach is useful in certain applications. For instance, 
when a piecewise CT signal is reconstructed from an infinite series (such as the 
Fourier series defined later in the text), the reconstructed value at the point of 
discontinuity satisfies Eq. (1.1). Discussion of piecewise CT signals is continued 
in Chapter 4, where we define the CT Fourier series. 


1.1.2 Analog and digital signals 

A second classification of signals is based on their amplitudes. The amplitudes 
of many real-world signals, such as voltage, current, temperature, and pressure, 
change continuously, and these signals are called analog signals. For example, 
the ambient temperature of a house is an analog number that requires an infinite 
number of digits (e.g., 24.763 578. . . ) to record the readings precisely. Digital 
signals, on the other hand, can only have a finite number of amplitude values. 
For example, if a digital thermometer, with a resolution of 1 °C and a range 
of [10°C, 30 °C], is used to measure the room temperature at discrete time 
instants, t — kT , then the recordings constitute a digital signal. An example of 
a digital signal was shown in Fig. 1.1(h), which plots the temperature readings 
taken once a day for one week. This digital signal has an amplitude resolution 
of 0.1 °C, and a sampling interval of one day. 

Figure 1 .5 shows an analog signal with its digital approximation. The analog 
signal has a limited dynamic range between [—1, 1] but can assume any real 
value (rational or irrational) within this dynamic range. If the analog signal is 
sampled at time instants t — kT and the magnitude of the resulting samples are 
quantized to a set of finite number of known values within the range [ — 1, 1], 
the resulting signal becomes a digital signal. Using the following set of eight 
uniformly distributed values, 

[-0.875, -0.625, -0.375, -0.125, 0.125, 0.375, 0.625, 0.875], 

within the range [—1, 1], the best approximation of the analog signal is the 
digital signal shown with the stem plot in Fig. 1.5. 

Another example of a digital signal is the music recorded on an audio com- 
pact disc (CD). On a CD, the music signal is first sampled at a rate of 44 100 
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Fig. 1.5. Analog signal with its 
digital approximation. The 
waveform for the analog signal 
is shown with a line plot; the 
quantized digital approximation 
is shown with a stem plot. 



sampling time t = kT 


samples per second. The sampling interval T is given by 1/44 100, or 22.68 
microseconds (ps). Each sample is then quantized with a 16-bit uniform quan- 
tizer. In other words, a sample of the recorded music signal is approximated 
from a set of uniformly distributed values that can be represented by a 16-bit 
binary number. The total number of values in the discretized set is therefore 
limited to 2 16 entries. 

Digital signals may also occur naturally. For example, the price of a com- 
modity is a multiple of the lowest denomination of a currency. The grades of 
students on a course are also discrete, e.g. 8 out of 10, or 3.6 out of 4 on a 4-point 
grade point average (GPA). The number of employees in an organization is a 
non-negative integer and is also digital by nature. 


1.1.3 Periodic and aperiodic signals 

A CT signal x(t) is said to be periodic if it satisfies the following property: 

x(t) = x{t + To), (1.2) 

at all time t and for some positive constant Tq. The smallest positive value 
of Tq that satisfies the periodicity condition, Eq. (1.3), is referred to as the 
fundamental period of x(t). 

Likewise, a DT signal x[k] is said to be periodic if it satisfies 

x[k] = x[k + K 0 ] (1.3) 

at all time k and for some positive constant Kq. The smallest positive value of 
Kq that satisfies the periodicity condition, Eq. (1.4), is referred to as the fun- 
damental period of x[k], A signal that is not periodic is called an aperiodic or 
non-periodic signal. Figure 1 .6 shows examples of both periodic and aperiodic 
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(c) 


(d) 



3 

2 

It}--. 

-5 -4 -3 -2 -1 0 1 2 34 5 

(f) 


>k 


Fig. 1.6. Examples of periodic 
((a), (c), and (e)) and aperiodic 
((b), (d), and (f)) signals. The 
line plots (a) and (c) represent 
CT periodic signals with 
fundamental periods T 0 of 4 and 
2, while the stem plot (e) 
represents a DT periodic signal 
with fundamental period 
Kq = 8. 


signals. The reciprocal of the fundamental period of a signal is called the fun- 
damental frequency. Mathematically, the fundamental frequency is expressed 
as follows 


1 1 

fo = — , for CT signals, or /o = — , for DT signals, (1.4) 
To K o 

where Tq and Kq are, respectively, the fundamental periods of the CT and DT 
signals. The frequency of a signal provides useful information regarding how 
fast the signal changes its amplitude. The unit of frequency is cycles per second 
(c/s) or hertz (Hz). Sometimes, we also use radians per second as a unit of 
frequency. Since there are 2n radians (or 360°) in one cycle, a frequency of /o 
hertz is equivalent to lirfo radians per second. If radians per second is used as 
a unit of frequency, the frequency is referred to as the angular frequency and is 
given by 


a>o = — , for CT signals, or Ik) = — , for DT signals. (1.5) 
To Kq 

A familiar example of a periodic signal is a sinusoidal function represented 
mathematically by the following expression: 


x(t) = A sin(&>of + 0). 
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The sinusoidal signal x(t) has a fundamental period To = 2n/coo as we prove 
next. Substituting t by t + To in the sinusoidal function, yields 

x(t + T 0 ) = A sin(&>of + coqTo + 9). 


Since 

x(t ) = A sin(a>of + 6) = A sin(&>of + 2m jt + 9), for m = 0, ±1, ±2, . . . , 

the above two expressions are equal iff cooTq = 2mit. Selecting m = 1, the 
fundamental period is given by Tq = 2n / coq. 

The sinusoidal signal x(t) can also be expressed as a function of a complex 
exponential. Using the Euler identity, 

e j("or+<?) = cos(a> 0 r + 9) + j sin(&>(7 + 9), (1.6) 

we observe that the sinusoidal signal x(t) is the imaginary component of a 
complex exponential. By noting that both the imaginary and real components 
of an exponential function are periodic with fundamental period To — 2jt/a>o, 
it can be shown that the complex exponential x(t) = exp[j(ft>ot + 9)] is also a 
periodic signal with the same fundamental period of To — 2n /u>o. 


Example 1.3 

(i) CT sine wave: x\ (t) = sin(47rr) is a periodic signal with period 7) = 

2tc / Ajt = 1/2; 

(ii) CT cosine wave: *2(0 = cos(37rt) is a periodic signal with period 7) = 
2tc /3tc = 2/3; 

(iii) CT tangent wave: xAt) — tan(10t) is a periodic signal with period 7/ = 
tt/10; 

(iv) CT complex exponential: Xa ( t) = e 1 ' 2 ' 47 ' is a periodic signal with period 


Ta = 2n/2 = Tt\ 

(v) CT sine wave of limited duration: xo (t) = 


sin Arct 

0 


-2<t <2 . 

, . is an 

otherwise 


aperiodic signal; 

(vi) CT linear relationship: xy(t) = 2t + 5 is an aperiodic signal; 

(vii) CT real exponential: xa (?) = e 2 ' is an aperiodic signal. 


Although all CT sinusoidals are periodic, their DT counterparts x[k~\ = 
A sin(f2o£ + 9) may not always be periodic. In the following discussion, we 
derive a condition for the DT sinusoidal x[k] to be periodic. 

Assuming x[k\ = A sin (Co 7' + 9) is periodic with period Kq yields 


x[k + A/)] = sin(C 0 (7 + K 0 ) + 9) — sin(C 0 ^ + f2 0 K 0 ) + 9). 


Since a [A'] can be expressed as x[k] = sin(l?o^ + 2nnt + 9), the value of the 
fundamental period is given by Ko = 2nm / Q () for m — 0, ±1, ±2, . . . Since 
we are dealing with DT sequences, the value of the fundamental period Kq must 
be an integer. In other words, x[k] is periodic if we can find a set of values for 
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m, Kq e Z + , where we use the notation Z + to denote a set of positive integer 
values. Based on the above discussion, we make the following proposition. 

Proposition 1.1 An arbitrary DT sinusoidal sequence x [k] = A sin(Go£ + 0) is 
periodic iff Dq/2tc is a rational number. 

The term rational number used in Proposition 1 . 1 is defined as a fraction of 
two integers. Given that the DT sinusoidal sequence x[k] = A sin(Go k + 0 ) is 
periodic, its fundamental period is evaluated from the relationship 


Proposition 1.1 can be extended to include DT complex exponential signals. 

Collectively, we state the following. 

( 1 ) The fundamental period of a sinusoidal signal that satisfies Proposition 1 . 1 
is calculated from Eq. (1.8) with m set to the smallest integer that results 
in an integer value for Kq. 

(2) A complex exponential x [A] = A exp [j( Go A + 0)] must also satisfy Propo- 
sition 1.1 to be periodic. The fundamental period of a complex exponential 
is also given by Eq. (1.8). 

Example 1.4 

Determine if the sinusoidal DT sequences (i)-(iv) are periodic: 

(i) f[k ] = sin(7rA/12 + 7 t/4); 

(ii) g[A] = cos(37rA/10 + 0); 

(iii) h[k] — cos(0.5A + 0); 

(iv) p[k] = e j(7^/8+0). 

Solution 

(i) The value of £2o in f[k\ is 7T/12. Since Qq/Itt = 1 /24 is a rational number, 

the DT sequence f[k] is periodic. Using Eq. (1.8), the fundamental period of 

f[k] is given by 


Setting m — 1 yields the fundamental period Kq — 24. 

To demonstrate that f[k] is indeed a periodic signal, consider the following: 


Go m 
2 JT Kq 


(1.7) 


as 



( 1 . 8 ) 


K o = — m = 24 m. 
G 0 


f[k + K 0 ] = sin(jr [fc + K 0 \/ 12 + jr/4). 
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Substituting Kq = 24 in the above equation, we obtain 

f[k + K 0 ] = sin(:/r[A + A'o]/12 + 7r/4) = sin(7rA + 2jt + n / 4) 
= sin(jrA/12 + tt/4) = f[k]. 


(ii) The value of fi o in g[k ] is 37T/10. Since Q.q/2tz = 3/20 is a rational 
number, the DT sequence g[A] is periodic. Using Eq. (1.8), the fundamental 
period of g[A] is given by 

2jt 20 m 

K 0 = —m = 


Setting m — 3 yields the fundamental period Kq — 20. 

(iii) The value of Oq in h[k] is 0.5. Since Qq/2tt = \/An is not a rational 
number, the DT sequence h[k] is not periodic. 

(iv) The value of Qq in p\k] is 77 t/ 8. Since fto/2n = 7/16 is a rational 
number, the DT sequence p[k] is periodic. Using Eq. (1.8), the fundamental 
period of p[k] is given by 

2tt 1 6m 


Setting m = 7 yields the fundamental period Kq = 16. 

Example 1.3 shows that CT sinusoidal signals of the form x(t) = 
sinOuot + 0 ) are always periodic with fundamental period 2 tt /coq irrespective of 
the value of a>o . However, Example 1.4 shows that the DT sinusoidal sequences 
are not always periodic. The DT sequences are periodic only when Qq/2tc is a 
rational number. This leads to the following interesting observation. 

Consider the periodic signal x(t) = sinfeof + 9). Sample the signal with a 
sampling interval T . The DT sequence is represented as x[A] = sin(tt>oAT + 9). 
The DT signal will be periodic if Qq/2tt = coqT /27r is a rational number. In 
other words, if you sample a CT periodic signal, the DT signal need not always 
be periodic. The signal will be periodic only if you choose a sampling interval 
T such that the term coqT /27r is a rational number. 


1.1.3.1 Harmonics 


Consider two sinusoidal functions x(t) = sin(&>of + 9) and x m (t) = 
sinimaiQt + 0). The fundamental angular frequencies of these two CT signals 
are given by coq and ma > o radians/s, respectively. In other words, the angular 
frequency of the signal x m (t) is m times the angular frequency of the signal 
x{t). In such cases, the CT signal x m (t) is referred to as the mth harmonic of 
x{t). Using Eq. (1.6), it is straightforward to verify that the fundamental period 
of x(t) is m times that of x m (t). 

Figure 1.7 plots the waveform of a signal x(t) = sin(2jrr) and its second har- 
monic. The fundamental period of x(t) is 1 s with a fundamental frequency of 
2 7t radians/s. The second harmonic of x(t) is given by xn(t) — sin(4;rf ). Like- 
wise, the third harmonic of x{t) is given by X 3 (t) = sin(6jr t). The fundamental 
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Fig. 1.7. Examples of harmonics, 
(a) Waveform for the sinusoidal 
signal x(t) = sin(27r f); (b) 
waveform for its second 
harmonic given by 
x 2 (t) = sin(4jrf). 


periods of the second harmonic X 2 (t) and third harmonics x-$(t) are given by 
1 /2 s and 1 /3 s, respectively. 

Harmonics are important in signal analysis as any periodic non-sinusoidal 
signal can be expressed as a linear combination of a sine wave having the same 
fundamental frequency as the fundamental frequency of the original periodic 
signal and the harmonics of the sine wave. This property is the basis of the 
Fourier series expansion of periodic signals and will be demonstrated with 
examples in later chapters. 


1. 1.3.2 Linear combination of two signals 

Proposition 1.2 A signal g(t) that is a linear combination of two periodic sig- 
nals, .ri(f) with fundamental period T\ and X 2 (t) with fundamental period T 2 as 
follows: 


g(t) = axi(t) + bx 2 (t) 


is periodic iff 


T 1 m 

— = — = rational number. 
T 2 n 


(1.9) 


The fundamental period of g(t ) is given by nT\ = mT 2 provided that the values 
ofm and n are chosen such that the greatest common divisor (gcd) between m 
and n is 1 . 


Proposition 1.2 can also be extended to DT sequences. We illustrate the 
application of Proposition 1.2 through a series of examples. 


Example 1.5 

Determine if the following signals are periodic. If yes, determine the funda- 
mental period. 


(i) gj(f) = 3 sin(47rt) + 7cos(3^f); 

(ii) £ 2(0 — 3 sin(47Tf) + 7 cos(lOf). 
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Solution 

(i) In Example 1.3, we saw that the sinuosoidal signals sin(47r?) and cos(3jrr) 
are both periodic signals with fundamental periods 1/2 and 2/3, respectively. 
Calculating the ratio of the two fundamental periods yields 

7/ _ 1/2 _ 3 
7/ ~ 2/3 ~ 4’ 

which is a rational number. Hence, the linear combination gi(f) is a periodic 
signal. 

Comparing the above ratio with Eq. (1.9), we obtain m — 3 and n = 4. The 
fundamental period of gi(t) is given by nT\ = 47/ = 2 s. Alternatively, the 
fundamental period of gi(t) can also be evaluated from mT 2 = 37'2 = 2 s. 

(ii) In Example 1.3, we saw that sin(47rf) and 7 cos(10/) are both periodic 
signals with fundamental periods 1/2 and jt/5, respectively. Calculating the 
ratio of the two fundamental periods yields 

7/ _ 1/2 _ 5 
T 2 jt/ 5 2: x ’ 

which is not a rational number. Hence, the linear combination g 2 (t) is not a 
periodic signal. 

In Example 1.5, the two signals gi(f) = 3 sin(4^r) + 7 cos(3jt?) and g 2 (t) = 
3 sin(47rt) + 7 cos(lOr) are almost identical since the angular frequency of the 
cosine terms in gi(f) is 37r = 9.426, which is fairly close to 10, the fundamental 
frequency for the cosine term in g 2 (t). Even such a minor difference can cause 
one signal to be periodic and the other to be non-periodic. Since gi(t) satisfies 
Proposition 1.2, it is periodic. On the other hand, signal g 2 (t) is not periodic 
as the ratio of the fundamental periods of the two components, 3 sin(47rf ) and 
7 sin(10r), is 5/2jr, which is not a rational number. 

We can also illustrate the above result graphically. The two signals g\(t) and 
g 2 (t) are plotted in Fig. 1.8. It is observed that gi(t) is repeating itself every two 
time units, as shown in Fig. 1.8(a), where an arrowed horizontal line represents 
a duration of 2 s. From Fig 1.8(b), it appears that the wavefonn of g 2 (t) is also 
repetitive. Observing carefully, however, reveals that consecutive durations of 
2 s in g 2 (t) are slightly different. For example, the amplitude of g 2 (t) at the two 
ends of the arrowed horizontal line (of duration 2 s) are clearly different. Signal 
g 2 (t) is not therefore a periodic waveform. 

We should also note that a periodic signal by definition must strictly start at 
t = — oo and continue on forever till t approaches +oo. In practice, however, 
most signals are of finite duration. Therefore, we relax the periodicity condition 
and consider a signal to be periodic if it repeats itself during the time it is 
observed. 
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-4 -3 -2 -1 0 1 2 3 4 



(a) (b) 

Fig. 1.8. Signals (a) g , ( t ) and (b) g 2 (t) considered in Example 1.5. Signal g , (f) is periodic with a 
fundamental period of 2 s, while g 2 (t) is not periodic. 


1.1.4 Energy and power signals 

Before presenting the conditions for classifying a signal as an energy or a power 
signal, we present the formulas for calculating the energy and power in a signal. 

The instantaneous power at time / = f 0 of a real-valued CT signal x(t) is 
given by x 2 (to). Similarly, the instantaneous power of a real-valued DT signal 
x[k] at time instant k — ko is given by x 2 [k~\. If the signal is complex- valued, 
the expressions for the instantaneous power are modified to |x(fo )| 2 or |x|To] | 2 , 
where the symbol | ■ | represents the absolute value of a complex number. 

The energy present in a CT or DT signal within a given time interval is given 
by the following: 

Ti 

CT signals E (Ti j 2) = J \x{t)\ 2 dt in interval? = ( 7 ), T2) with?2 > 

Ti 

( 1 . 10 a) 

Ni 

DT sequences E^, at 2 ] = | x [k\ \ 2 in interval k = [A'i, N2] with ^2 > N 1. 

k=N t 

(1.10b) 

The total energy of a CT signal is its energy calculated over the interval t = 
[—00, 00]. Likewise, the total energy of a DT signal is its energy calculated over 
the ranged = [—00, 00]. The expressions forthe total energy are therefore given 
by the following: 

OO 

E x = J \x{t)\ 2 dt- 


CT signals 


( 1 . 11 a) 
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OO 


DT sequences E x = |x[k]| 2 . (1.11b) 

k = — oo 

Since power is defined as energy per unit time, the average power of a CT 
signal x{t) over the interval t = (— oo, oo) and of a DT signal x[k] over the 
range k = [— oo, oo] are expressed as follows: 

T /2 

CT signals P x = lim — f |x(f)| 2 dr. (1.12) 

T^oo T J 


DT sequences 


-T/2 
K 


P r = 


2 K 


1 A 

— T 
+ 1 M 


\x[k]\~ 


k=—K 


(1.13) 


Equations (1.12) and (1.13) are simplified considerably for periodic signals. 
Since a periodic signal repeats itself, the average power is calculated from one 
period of the signal as follows: 

h+To 

CT signals P x = 1 j \x(t)\ 2 dt = 1 / |x(f)| 2 dr, (1.14) 

(To) h 

j j k\ + A'p — 1 

DT sequences P x = — Y \x[k]\ 2 = — Y \x[k] | 2 , (1.15) 

* 0 k=(K 0 ) k=ki 

where t\ is an arbitrary real number and k\ is an arbitrary integer. The symbols 
To and Kq are, respectively, the fundamental periods of the CT signal x(t) and 
the DT signal x[k}. In Eq. (1.14), the duration of integration is one complete 
period over the range |/| , t\ + To], where t\ can take any arbitrary value. In 
other words, the lower limit of integration can have any value provided that the 
upper limit is one fundamental period apart from the lower limit. To illustrate 
this mathematically, we introduce the notation / ,j a) to imply that the integration 
is performed over a complete period To and is independent of the lower limit. 
Likewise, while computing the average power of a DT signal x[k\, the upper 
and lower limits of the summation in Eq. (1.15) can take any values as long as 
the duration of summation equals one fundamental period Kq. 

A signal x(t), or x\k], is called an energy signal if the total energy E x has 
a non-zero finite value, i.e. 0 < E x < oo. On the other hand, a signal is called 
a power signal if it has non-zero finite power, i.e. 0 < P x < oo. Note that a 
signal cannot be both an energy and a power signal simultaneously. The energy 
signals have zero average power whereas the power signals have infinite total 
energy. Some signals, however, can be classified as neither power signals nor as 
energy signals. For example, the signal e 2l u(t) is a growing exponential whose 
average power cannot be calculated. Such signals are generally of little interest 
to us. 

Most periodic signals are typically power signals. For example, the average 
power of the CT sinusoidal signal, or A sin(&>of + 0), is given by A 2 / 2 (see 
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(a) (b) 


Fig. 1.9. CT signals for Example Problem 1.6). Similarly, the average power of the complex exponential signal 
1 - 6 - A exp(j&>oO is given by A 2 (see Problem 1.8). 


Example 1.6 

Consider the CT signals shown in Figs. 1.9(a) and (b). Calculate the instanta- 
neous power, average power, and energy present in the two signals. Classify 
these signals as power or energy signals. 


Solution 

(a) The signal x(t) can be expressed as follows: 


x(t) = 


5 

0 


-2<t <2 
otherwise. 


The instantaneous power, average power, and energy of the signal are calculated 
as follows: 


instantaneous power 


energy 


average power 


P,(t) = 


25 -2<t <2 
0 otherwise; 

OO 2 


E x = 


= J \x(t)\ 2 dt = J 25 dr = 100; 


-2 


P x — lim —E x = 0. 

T — > oo T 


Because x(t) has finite energy (0 < E x = 100 < oo) it is an energy signal. 

(b) The signal z(t) is a periodic signal with fundamental period 8 and over 
one period is expressed as follows: 


z{t) = 


5 

0 


-2 < t < 2 
2 < \t\ < 4, 


with z(t + 8) = z(t). The instantaneous power, average power, and energy of 
the signal are calculated as follows: 

25 —2 < t < 2 
0 2<\t\<4 


instantaneous power P : (t) = 
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and P-(t + 8) = P z (t); 

4 2 

1 f , If 100 

average power P z = - : : \z(t)\ dt = - / 25 dr = = 12.5; 

8 J 8 J 8 

-4 -2 

oo 

energy E z = J |z(t)| 2 dr = oo. 

— OO 

Because the signal has finite power (0 < P z = 12.5 < oo), z(r) is a power 
signal. 

Example 1.7 

Consider the following 


Determine if the signal 

Solution 

The total energy of the DT sequence is calculated as follows: 

OO OO OO j 

E f =J2 l/WI 2 = I]l e “ 0 - 5 *l 2 = I]( e_1 ) t = T3^r wL582 - 

*=-00 k =0 k = 0 1 e 

Because Ef is finite, the DT sequence f[k] is an energy signal. 

In computing Ef, we make use of the geometric progression (GP) series to 
calculate the summation. The formulas for the GP series are considered in 
Appendix A. 3. 

Example 1.8 

Determine if the DT sequence g[£] = 3 cosfjr A / 1 0) is a power or an energy 
signal. 


DT sequence: 

r e -°. 5 * *> 0 

/l 1 (0 k < 0. 

is a power or an energy signal. 


Solution 

The DT sequence g[£] = 3 cosijrA/lO) is a periodic signal with a fundamental 
period of 20. All periodic signals are power signals. Hence, the DT sequence 
g[£] is a power signal. 

Using Eq. (1.15), the average power of g[/c] is given by 



term I term II 


20 


Part I Introduction to signals and systems 


Clearly, the summation represented by term I equals 9(20)/40 = 4.5. To com- 
pute the summation in term II, we express the cosine as follows: 
q 19 I q 19 q 19 

term II = - V -[e j * i/5 + e~^ 5 ] = - V (e^ 5 )* + - V 

40 4-^ 2 80 v ’ so v ’ 


80 


A-0 


80 


k = 0 


Using the formulas for the GP series yields 
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■ /s , 1 - ( e Jjr / 5 ) 20 1 - e J 4 1 - 1 

y (e J7r/5 / = V . ’ = — = — = 0 

1 — f e J 77 "/ ' - ' ' 


and 


k = 0 
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( e j^/ 5 ) l _ (e^/ 5 ) 1 - (e^/ 5 ) 


1 - 1 


E l _ o-W5\20 1 — p-j lr4 

, -jjr/5yfc = 1 l e > = 1 e = 

1 - (e^/ 5 ) 1 - (e-^/S) 1 - (el 71 '/ 5 ) 


= 0. 


k = 0 


Term II, therefore, equals zero. The average power of g[k] is therefore given 
by 


P g = 4.5 + 0 = 4.5. 

In general, a periodic DT sinusoidal signal of the form x[£] — A cos 
(cook + 0) has an average power P x = A 2 /2. 


1.1.5 Deterministic and random signals 

If the value of a signal can be predicted for all time (t or k) in advance without 
any error, it is referred to as a deterministic signal. Conversely, signals whose 
values cannot be predicted with complete accuracy for all time are known as 
random signals. 

Deterministic signals can generally be expressed in a mathematical, or graph- 
ical, form. Some examples of deterministic signals are as follows. 


(1) CT sinusoidal signal: X\ (t) = 5 sin(207r/ + 6); 

(2) CT exponentially decaying sinusoidal signal: X2 (t) = 2e - ' sin(7?); 

{e> 4nt hi <5 


(3) CT finite duration complex exponential signal: x^t) = 


0 


elsewhere; 


(4) DT real-valued exponential sequence: Xrl/c] = 4e 2k \ 

(5) DT exponentially decaying sinusoidal sequence: x$[k] = 3e 2k x 



Unlike deterministic signals, random signals cannot be modeled precisely. 
Random signals are generally characterized by statistical measures such as 
means, standard deviations, and mean squared values. In electrical engineering, 
most meaningful information-bearing signals are random signals. In a digital 
communication system, for example, data are generally transmitted using a 
sequence of zeros and ones. The binary signal is corrupted with interference 
from other channels and additive noise from the transmission media, resulting 
in a received signal that is random in nature. Another example of a random 
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signal in electrical engineering is the thermal noise generated by a resistor. The 
intensity of the thermal noise depends on the movement of billions of electrons 
and cannot be predicted accurately. 

The study of random signals is beyond the scope of this book. We therefore 
restrict our discussion to deterministic signals. However, most principles and 
techniques that we develop are generalizable to random signals. The readers 
are advised to consult more advanced books for analysis of random signals. 


1.1.6 Odd and even signals 

A CT signal x e (t ) is said to be an even signal if 

x e (t) = x e (-t). (1.16) 

Conversely, a CT signal x Q (t) is said to be an odd signal if 

x 0 (t) = -x 0 (-t). (1.17) 

A DT signal x e [k] is said to be an even signal if 

x e [k] = x e [~k]. (1.18) 

Conversely, a DT signal x a [k] is said to be an odd signal if 

x a [k] = -x 0 [-k]. (1.19) 

The even signal property, Eq. (1.16) for CT signals or Eq. (1.18) for DT sig- 
nals, implies that an even signal is symmetric about the vertical axis (t = 0). 
Likewise, the odd signal property, Eq. (1.17) for CT signals or Eq. (1.19) for 
DT signals, implies that an odd signal is antisymmetric about the vertical axis 
(t = 0). The symmetry characteristics of even and odd signals are illustrated 
in Fig. 1.10. The waveform in Fig 1.10(a) is an even signal as it is symmetric 
about the y-axis and the wavefonn in Fig. 1.10(b) is an odd signal as it is anti- 
symmetric about the y-axis. The waveforms shown in Figs. 1.6(a) and (b) are 
additional examples of even signals, while the waveforms shown in Figs. 1 .6(c) 
and (e) are examples of odd signals. 

Fig 1 10 Example of (a) an Most practical signals are neither odd nor even. For example, the signals 

even signal and (b) an odd shown in Figs. 1.6(d) and (f), and 1.8(a) do not exhibit any symmetry about 

signal. the y-axis. Such signals are classified in the “neither odd nor even” category. 
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Neither odd nor even signals can be expressed as a sum of even and odd signals 
as follows: 

x(t) = x e (t ) + x Q (t ), 

where the even component x e (t ) is given by 

1 

Xo(t) = ^[x(t) + x(-t)], 

while the odd component x 0 (t ) is given by 

1 

X 0 (t)= ~[x(t) - x(-t)]. 


( 1 . 20 ) 


(1.21) 


Example 1.9 

Express the CT signal 


x(t) 


/ 

0 


0 < t < 1 
elsewhere 


as a combination of an even signal and an odd signal. 


Solution 

In order to calculate x c (t) and x a (t), we need to calculate the function x(—t), 
which is expressed as follows: 

, „ -t 0 < -t < 1 -t — 1 < t < 0 

x( — t ) = = 

0 elsewhere 0 elsewhere. 


Using Eq. (1.20), the even component x e (t) of x(t) is given by 


1 

x e (t) = ~[x{t) + x(-t)] 


1 


-t 

0 < t < 1 

2 


1 

-1 < t < 0 

— t 

2 


0 

elsewhere. 


while the odd component x 0 (t) is evaluated from Eq. (1.21) as follows: 


1 

x 0 {t) = ~[x(t) - x(-t)\ = 


1 

0 < t < 1 

-t 

2 


1 

-1 < t < 0 

-t 

2 


0 

elsewhere. 


The waveforms for the CT signal x(t ) and its even and odd components are 
plotted in Fig. 1.11. 
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Fig. 1.11. (a) The CT signal x(t) 
for Example 1.9. (b) Even 
component of x(t). (c) Odd 
component of x(t). 



1.1. 6.1 Combinations of even and odd CT signals 

Consider g e (t ) and h e (t) as two CT even signals and g Q (t ) and h a (t) as two 

CT odd signals. The following properties may be used to classify different 

combinations of these four signals into the even and odd categories. 

(i) Multiplication of a CT even signal with a CT odd signal results in a CT 
odd signal. The CT signal x{t ) = g e {t) x g 0 (t) is therefore an odd signal. 

(ii) Multiplication of a CT odd signal with another CT odd signal results in a 
CT even signal. The CT signal l:(t) = g a (t ) x h 0 {t) is therefore an even 
signal. 

(iii) Multiplication of two CT even signals results in another CT even signal. 
The CT signal z(t) = g e (t) x h c (t) is therefore an even signal. 

(iv) Due to its antisymmetry property, a CT odd signal is always zero at t = 0. 
Therefore, g o (0) = /? o (0) = 0. 

(v) Integration of a CT odd signal within the limits [-T, T] results in a zero 
value, i.e. 

T T 

f 8o mt = fh o m t = 0. (i.22) 

-T -T 

(vi) The integral of a CT even signal within the limits [— T , T ] can be simplified 
as follows: 


T T 

J geCOdf = 2 J ge(t)dt. (1.23) 

-T 0 

It is straightforward to prove properties (i)-(vi). Below we prove property 

(vi). 
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Proof of property (vi) 

By expanding the left-hand side of Eq. (1.23), we obtain 


-T 


TOT 

f ge(Odf = J g e (t)dt + J g c (t)dt. 

-T 0 

integral I integral II 


Substituting a = — t in integral I yields 


U 11 

integral I = J g e (-a)(-da) = J g c (o?)da = J g e (t)dt = integral II, 


which proves Eq. (1.23). 


1.1. 6.2 Combinations of even and odd DT signals 

Properties (i)-(vi) for CT signals can be extended to DT sequences. Consider 

g e [T] and h e [k] as even sequences and g 0 [£] and h Q [k] are as odd sequences. 

For the four DT signals, the following properties hold true. 

(i) Multiplication of an even sequence with an odd sequence results in an odd 
sequence. The DT sequence x [£] = g e OT x g 0 [k], for example, is an odd 
sequence. 

(ii) Multiplication of two odd sequences results in an even sequence. The DT 
sequence h[k] = g 0 [/c] x h 0 [k\, for example, is an even sequence. 

(iii) Multiplication of two even sequences results in an even sequence. The DT 
sequence z[A] = g e [k] x h e [k], for example, is an even sequence. 

(iv) Due to its antisymmetry property, a DT odd sequence is always zero at 
k = 0. Therefore, g o [0] = /i o [0] = 0. 

(v) Adding the samples of a DT odd sequence g 0 [k] within the range [— M, 
M] is 0, i.e. 

M M 

£*«>[*] = 0 =£ /a*]- (1.24) 

k=-M k=—M 

(vi) Adding the samples of a DT even sequence g e [k] within the range [— M, 
M] simplifies to 


M 


M 


£ Se[*] = *e[0] + 2j> e [*]. 
k=—M k= 1 


(1.25) 
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1.2 Elementary signals 


In this section, we define some elementary functions that will be used frequently 
to represent more complicated signals. Representing signals in terms of the 
elementary functions simplifies the analysis and design of linear systems. 


1.2.1 Unit step function 


1 t > o 

0 t < 0. 


The CT unit step function u(t ) is defined as follows: 

u(t) = 

The DT unit step function u[k] is defined as follows: 

I 1 

" [tl= 0 k < 0. 


(1.26) 


(1.27) 


The waveforms for the unit step functions u(t) and u\k~\ are shown, respectively, 
in Figs. 1.12(a) and (b). It is observed from Fig. 1.12 that the CT unit step 
function u(t ) is piecewise continuous with a discontinuity at t = 0. In other 
words, the rate of change in u{t) is infinite at t — 0. However, the DT function 
u[k\ has no such discontinuity. 


1.2.2 Rectangular pulse function 


The CT rectangular pulse rect (f/r) is defined as follows: 


\t\ < r/2 


rect - = I (1.28) 

W lo |r| > r/2 

and it is plotted in Fig. 1.12(c). The DT rectangular pulse rect(k/(2N + 1)) is 
defined as follows: 


rect 


2 N + 1 


and it is plotted in Fig. 1.12(d). 


1 |£| < N 

0 \k\ > N 


(1.29) 


1.2.3 Signum function 


The signum (or sign) function, denoted by sgn(t), is defined as follows: 


sgn(t) 


1 

0 

-1 


t > 0 
t = 0 
t < 0. 


(1.30) 


The CT sign function sgn(t) is plotted in Fig. 1.12(e). Note that the operation 
sgn(-) can be used to output the sign of the input argument. The DT signum 
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1 

x(t) = u(t ) 


(a) 

1 

x(f) = rect(4) 





_! 0 1 
2 2 

(C) 


[ x[ k] = u[k ] 



(b) 

! x ^ = rect (w+i) 


► k 

-NON 

(d) 



(e) (f) 




Fig. 1.12. CT and DT elementary functions, (a) CT and (b) DT unit step functions, (c) CT and (d) DT rectangular pulses, (e) CT and 
(f) DT signum functions, (g) CT and (h) DT ramp functions, (i) CT and (j) DT sinusoidal functions, (k) CT and (I) DT sine functions. 
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function, denoted by sgn(£), is defined as follows: 
sgn[A] 

and it is plotted in Fig. 1.12(f). 


1 

0 

-1 


k > 0 
k = 0 
k < 0 


(1.31) 


1.2.4 Ramp function 


The CT ramp function r(t) is defined as follows: 


r(t) — tu(t) 


i 

0 


t > 0 
t < 0, 


(1.32) 


which is plotted in Fig. 1.12(g). Similarly, the DT ramp function r[k\ is defined 
as follows: 


r[k] = ku[k] = 


k 

0 


k > 0 
k < 0, 


which is plotted in Fig. 1.12(h). 


(1.33) 


1.2.5 Sinusoidal function 

The CT sinusoid of frequency /o (or, equivalently, an angular frequency wq = 
2jrfo) is defined as follows: 

x{t) = sin(&>of + 0) = sin(27r/of + 9), (1-34) 

which is plotted in Fig. 1.12(i). The DT sinusoid is defined as follows: 

x[k] = sin(l?o£ + 9) = sin(2:r/o£ + 9), (1.35) 

where Qq is the DT angular frequency. The DT sinusoid is plotted in 
Fig. 1.12(j). As discussed in Section 1.1.3, a CT sinusoidal signal x(t) = 
sin(ft>of + 0) is always periodic, whereas its DT counterpart .v[/c] = sin(.!2o£ + 
9) is not necessarily periodic. The DT sinusoidal signal is periodic only if the 
fraction T?o /2jr is a rational number. 


1.2.6 Sine function 


The CT sine function is defined as follows: 

sin(;ra>oO 


sinc(&>oO = 


ncoot 


(1.36) 


which is plotted in Fig. 1.12(k). In some text books, the sine function is alter- 
natively defined as follows: 

sin(&>oO 


sinc(a>oO = 


coot 
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In this text, we will use the definition in Eq. (1.36) for the sine function. The 
DT sine function is defined as follows: 


sinc(l?o^) = 


sin(;r 12 oA') 
7r ftak 


which is plotted in Fig. 1.12(1). 


(1.37) 


1.2.7 CT exponential function 

A CT exponential function, with complex frequency s = a +j&>o, is repre- 
sented by 

x(t) = e st = e (CT+j<Uo) ' = e CTr (cos co 0 t + j sincuoO- (1.38) 

The CT exponential function is, therefore, a complex-valued function with the 
following real and imaginary components: 

real component Re{e sf } = e CT ' cos coot - , 

imaginary component Im{e ir } = e at sin coot. 

Depending upon the presence or absence of the real and imaginary components, 
there are two special cases of the complex exponential function. 

Case 1 Imaginary component is zero (ojq = 0) 

Assuming that the imaginary component co of the complex frequency s is zero, 
the exponential function takes the following form: 

x(t) = e al , 


which is referred to as a real-valued exponential function. Figure 1.13 shows the 
real-valued exponential functions for different values of a . When the value of a 
is negative (er < 0) then the exponential function decays with increasing time t. 



0 


► t 


x(t) = e m , cr = 0 

1 


0 


>■ t 


(a) 


(b) 


Fig. 1.13. Special cases of 
real-valued CT exponential 
function x(t) = exp(crf). 

(a) Decaying exponential with 
cr < 0. (b) Constant with 
cr = 0. (c) Rising exponential 
with a > 0. 



(c) 
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Fig. 1.14. CT complex-valued 
exponential function 
x (f) = exp(jft) 0 f)- (a) Real 
component; (b) imaginary 
component. 


The exponential function for o < 0 is referred to as a decaying exponential 
function and is shown in Fig. 1.13(a). For a — 0, the exponential function has 
a constant value, as shown in Fig. 1.13(b). For positive values of a (er > 0), 
the exponential function increases with time t and is referred to as a rising 
exponential function. The rising exponential function is shown in Fig. 1.13(c). 


Case 2 Real component is zero (a — 0) 

When the real component a of the complex frequency s is zero, the exponential 
function is represented by 

x(t) = e-i" 0 ' = cos coot +jsin&>of. 

In other words, the real and imaginary parts of the complex exponential are 
pure sinusoids. Figure 1.14 shows the real and imaginary parts of the complex 
exponential function. 

Example 1.10 

Plot the real and imaginary components of the exponential function x(t ) = 
exp[(j47r — 0.5)r] for —4 < t < 4. 

Solution 

The CT exponential function is expressed as follows: 

x(t) = ^ 4n -°- 5)t = e-°' 5 ' x e j4jr ' . 

The real and imaginary components of x(t) are expressed as follows: 

real component Re{(?)} = e~°' 5r cos(4;rf); 

imaginary component Im{(?)} = e~°' 5r sin(47rr). 

To plot the real component, we multiply the waveform of a cosine function 
with wo = 47r,as shown in Fig. 1.14(a), by a decaying exponential exp(— 0.5?). 
The resulting plot is shown in Fig. 1 .15(a). Similarly, the imaginary component 
is plotted by multiplying the waveform of a sine function with coq = 4n, as 
shown in Fig. 1.14(b), by a decaying exponential exp(— 0.5?). The resulting 
plot is shown in Fig. 1.15(b). 
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(a) (b) 

Fig. 1.15. Exponential function x(t) = exp[(j4?r - 0.5)f], (a) Real component; (b) imaginary 
component. 

1.2.8 DT exponential function 

The DT complex exponential function with radian frequency F?o is defined as 
follows: 


x[£] = e (CT+ i n °^ = e CT '(cos fiok + j sin l?o k.) (1-39) 

As an example of the DT complex exponential function, we consider x [£] = 
exp(j0.27T — 0.05 k), which is plotted in Fig. 1.16, where plot (a) shows the real 
component and plot (b) shows the imaginary part of the complex signal. 

Case 1 Imaginary component is zero (l?o = 0). The signal takes the following 
form: 

x[k] = e. ak 

when the imaginary component Qq of the DT complex frequency is zero. Similar 
to CT exponential functions, the DT exponential functions can be classified as 
rising, decaying, and constant-valued exponentials depending upon the value 
of a . 

Case 2 Real component is zero (a = 0). The DT exponential function takes 
the following form: 

x[k] = ej“ oi = cos wok + j sin 

Recall that a complex- valued exponential is periodic iff 1 ?o/ 27T is a rational 
number. An alternative representation of the DT complex exponential function 
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(b) 


Fig. 1.16. DT complex 
exponential function x[k] = 
expCfilnk - 0.05k). (a) Real 
component; (b) imaginary 
component. 


is obtained by expanding 

x[k] = = /, (1.40) 

where y = (a + jJ?o) is a complex number. Equation (1.40) is more compact 
thanEq. (1.39). 


1.2.9 Causal exponential function 

In practical signal processing applications, input signals start at time t = 0. 
Signals that start at t — 0 are referred to as causal signals. The causal exponential 
function is given by 


x(t ) = e sr u(t) = 


e 5 ' t > 0 

0 t < 0, 


(1.41) 


where we have used the unit step function to incorporate causality in the com- 
plex exponential functions. Similarly, the causal implementation of the DT 
exponential function is defined as follows: 


x[k] = e sk u[k] = 


e sk k > 0 

0 k < 0. 


(1.42) 


The same concept can be extended to derive causal implementations of sinu- 
soidal and other non-causal signals. 


Example 1.11 

Plot the DT causal exponential function x[k ] — e 1 ' 0 271 _af,5)<: ;<[&]. 


Solution 

The real and imaginary components of the non-causal signal e D0-27r 0.05)* are 
plotted in Fig. 1 . 1 6. To plot its causal implementation, we multiply e < j£>.2jr-o.05)A- 
by the unit step function u[k]. This implies that the causal implementation will 
be zero for k < 0. The real and imaginary components of the resulting function 
are plotted in Fig. 1.17. 
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Fig. 1.17. Causal DT complex exponential function xfH = exp(j0.2wA - 0.05 k)u[k], (a) Real component; 
(b) imaginary component. 


1.2.10 CT unit impulse function 

The unit impulse function 8(t), also known as the Dirac delta function^ or 
simply the delta function, is defined in terms of two properties as follows: 

(1) amplitude S{t) = 0, t ^ 0; (1.43a) 


(2) area enclosed 


CXJ 

/ 


8(t)dt = 1. 


(1.43b) 


Direct visualization of a unit impulse function in the CT domain is difficult. 
One way to visualize a CT impulse function is to let it evolve from a rectangular 
function. Consider a tall narrow rectangle with width s and height 1/e, as shown 
in Fig. 1.18(a), such that the area enclosed by the rectangular function equals 
one. Next, we decrease the width and increase the height at the same rate such 
that the resulting rectangular functions have areas = 1 . As the width s — > 0, 
the rectangular function converges to the CT impulse function 8(t ) with an 
infinite amplitude at t — 0. However, the area enclosed by CT impulse function 
is finite and equals one. The impulse function is illustrated in our plots by an 
arrow pointing vertically upwards; see Fig. 1.18(b). The height of the arrow 
corresponds to the area enclosed by the CT impulse function. 


Properties of impulse function 

(i) The impulse function is an even function, i.e. 8(t) = 8(—t). 

(ii) Integrating a unit impulse function results in one, provided that the limits 
of integration enclose the origin of the impulse. Mathematically, 


T 

J A8(t — to)dt 

7 


A 

0 


for — T < to < T 
elsewhere. 


(1.44) 


The unit impulse function was introduced by Paul Adrien Maurice Dirac (1902—1984), a British 
electrical engineer turned theoretical physicist. 
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Fig. 1.18. Impulse function S(t). 
(a) Generating the impulse 
function 6(f) from a rectangular 
pulse, (b) Notation used to 
represent an impulse function. 


(iii) The scaled and time-shifted version S(at + b) of the unit impulse function 
is given by 

S(at + b)=h(t+^j. (1.45) 


(iv) When an arbitrary function </>(f ) is multiplied by a shifted impulse function, 
the product is given by 


<p(t)8(t - t Q ) = <p(t 0 )8(t - t 0 ). (1.46) 

In other words, multiplication of a CT function and an impulse function 
produces an impulse function, which has an area equal to the value of the 
CT function at the location of the impulse. Combining properties (ii) and 
(iv), it is straightforward to show that 

OO 

J 4>(t)8{t - f 0 )df = 0(fo). d-47) 

— OO 


(v) The unit impulse function can be obtained by taking the derivative of the 
unit step function as follows: 

du 

m = —- (i.48) 

d t 

(vi) Conversely, the unit step function is obtained by integrating the unit 
impulse function as follows: 


uit) = 


I 


— OO 


<5(r)dr. 


(1.49) 


Example 1.12 

Simplify the following expressions: 
5 — if 

(i) ^(0; 

oo 

(ii) J (t + 5)S(t - 2)df; 


OO 

(iii) J e ja5lr “ +2 5(® - 5)d&>. 
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Solution 

5 ~)t 
1 + 1 

(ii) Using Eq. (1.46) yields 


(i) Using Eq. (1.46) yields — — - S(t ) = 


5 — 

1 + t 2 


t = o 


m = -m. 


oo 

/ 


oc 

/ 


(t + 5)8(t - 2)dt = / [(f + 5)] l=2 S(t - 2)dr = 7 


OO 

f s, '~ 


2)d t. 


Since the integral computes the area enclosed by the unit step function, which 
is one, we obtain 


OO 

/ 


OO 

= 7 / 


(t + 5)S(t - 2)d t = 7 / S(f - 2)d t = 7. 


(iii) Using Eq. (1.46) yields 


OO 

/ 


JO.5^+2^ _ 5)dft; = 


OO 

/ ^ 


57t<w+2 


]fi)=55(w - 5)d<w 


_ e j2.5ir+2 


J 8(a> — 5)dtt>. 

— OO 

Since exp(j2.57r + 2) = j exp(2) and the integral equals one, we obtain 


OO 

/ 


J0.5;r <o+2 S(fl) _ 5)dw = j e 2_ 


1.2.11 DT unit impulse function 

The DT impulse function, also referred to as the Kronecker delta function or 
the DT unit sample function, is defined as follows: 


8[k] = u[k] - u[k — 1] = 


1 k = 0 

0 k ± 0. 


(1.50) 


Unlike the CT unit impidse function, the DT impulse function has no ambiguity 
in its definition; it is well defined for all values of k. The waveform for a DT 
unit impulse function is shown in Fig. 1.19. 


1 ■ ' x[k\ = S[T] 

'I ►* 


Fig. 1.19. DT unit impulse 
function. 


0 
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3 


2 

x[k\ 


Xi [k\ = <5[&+ 1] 

1 

t 




1 

t 

T 




. . . . T 


-101 -101 


(a) 


(b) 


x 2 [k] = 28[k\ 

2 


-1 0 1 


> k 


3 x 3 M = 35[/t-l] 


-1 0 1 


>k 


(c) 


(d) 


Fig. 1.20. The DT functions in 
Example 1.13: (a) x[k], (b), x[k], 
(c) x 2 [k], and (d) x 3 [Ji:]. The DT 
function in (a) is the sum of the 
shifted DT impulse functions 
shown in (b), (c), and (d). 


Example 1.13 

Represent the DT sequence shown in Fig. 1.20(a) as a function of time-shifted 
DT unit impulse functions. 

Solution 

The DT signal x[k] can be represented as the summation of three functions, 
X\\ A], X 2 [A'], and x 3 [A], as follows: 


x[k] = X\[k] +x 2 [A] + x 3 [A], 


where xi[A], x 2 [k], and x 3 [A] are time-shifted impulse functions, 


X\ [A] = 5 [A + 1], x 2 [A] = 28 [A], and x 3 [A] = 45 [A - 1 ] , 


and are plotted in Figs. 1.20(b), (c), and (d), respectively. The DT sequence 
x[A] can therefore be represented as follows: 


x[k] = 5 [A + 1] + 25 [A] + 45 [A - 1], 


1.3 Signal operations 


An important concept in signal and system analysis is the transformation of a 
signal. In this section, we consider three elementary transformations that are 
performed on a signal in the time domain. The transformations that we consider 
are time shifting, time scaling, and time inversion. 

1.3.1 Time shifting 

The time-shifting operation delays or advances forward the input signal in time. 
Consider a CT signal (p(t) obtained by shifting another signal x(t) by T time 
units. The time-shifted signal <p{t) is expressed as follows: 


0(0 = x{t + T). 
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In other words, a signal time-shifted by T is obtained by substituting t in x(t) by 
(t + T).lfT < 0, then the signal x(t ) is delayed in the time domain. Graphically 
this is equivalent to shifting the origin of the signal x(t) towards the right-hand 
side by duration T along the /-axis. On the other hand, if 7 >0, then the 
signal x{t) is advanced forward in time. The plot of the time-advanced signal 
is obtained by shifting x(t) towards the left-hand side by duration V along the 
/-axis. 

Figure 1.21(a) shows a CT signal x(t) and the corresponding two time-shifted 
signals x(t — 3) and x{t + 3). Since x(t — 3) is a delayed version of x(t), the 
waveform of x(t — 3) is identical to that of x(t), except for a shift of three time 
units towards the right-hand side. Similarly, x{t + 3) is a time-advanced version 
of x(t). The waveform of x(t + 3) is identical to that of x(t) except for a shift 
of three time units towards the left-hand side. 

The theory of the CT time-shifting operation can also be extended to DT 
sequences. When a DT signal x\k] is shifted by m time units, the delayed signal 
<p[k ] is expressed as follows: 


c p[k ] — x[k + rri\. 

If m < 0, the signal is said to be delayed in time. To obtain the time-delayed 
signal 4>[k], the origin of the signal x[k] is shifted towards the right-hand side 
along the /.-axis by m time units. On the other hand, if m > 0, the signal 
is advanced forward in time. The time-advanced signal <p[k] is obtained by 
shifting x[k\ towards the left-hand side along the k- axis by m time units. 

Figure 1.22 shows a DT signal .v[/r] and the corresponding two time-shifted 
signals x[k — 4] and x[k + 4]. The waveforms of ,y[/t — 4] and x\k + 4] are 
identical to that of x [k] . The time-delayed signal x [ k — 4 ] is obtained by shifting 
x[k ] towards the right-hand side by four time units. The time-advanced signal 
x[k + 4] is obtained by shifting x[k] towards the left-hand side by four time 
units. 
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x[k\ x[k - 4 ] 



-8 -6 -4 -2 0 2 4 6 8 -8 -6 -4 -2 0 2 4 6 8 

(a) (b) 


Fig. 1.22. Time shifting of a DT 
signal, (a) Original DT signal 
x[k\. (b) Time-delayed version 
x\k - 4] of the DT signal x[/r], 
(c) Time-advanced version 
x[k + 4] of the DT signal x[k]. 


x[k + 4 ] 


A 

11 


-+/C 


-6 -4 -2 0 2 4 


(c) 


Example 1.14 

Consider the signal x(t ) = e~'u(t). Determine and plot the time-shifted versions 
x(t — 4) and x(t + 2). 


Solution 

The signal x(t) can be expressed as follows: 


x(t) — e 'u(t) 



l > 0 
elsewhere, 


(1.51) 


and is shown in Fig. 1.23(a). To determine the expression for x(t — 4), we 
substitute t by (f — 4) in Eq. (1.51). The resulting expression is given by 


x(t - 4) = 


6—0—4) 

0 


(f - 4) > 0 
elsewhere 


e ~ (r— 4) t > 4 

0 elsewhere. 


The function x(t — 4) is plotted in Fig. 1.23(b). 

Similarly, we can calculate the expression for x(t + 2) by substituting t by 
(t + 2) in Eq. (1.51). The resulting expression is given by 

+ J e_( ' +2) ( f + 2) > 0 

0 elsewhere 

e -(r+2) t > —2 
0 elsewhere. 


The function x(t + 2) is plotted in Fig. 1.23(c). From Fig. 1.23, we observe that 
the waveform for x(t — 4) can be obtained directly from x(t) by shifting the 
waveform of x(t) by four time units towards the right-hand side. Similarly, the 
waveform for x(1 + 2) can be obtained from x(t) by shifting the waveform of 
x(t) by two time units towards the left-hand side. This is the result expected 
from our previous discussion. 
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(a) 


Fig. 1.23. Time shifting of the 
CT signal in Example 1.14. 

(a) Original CT signal x(t). 

(b) Time-delayed version 

x(t - 4) of the CT signal x{t). 

(c) Time-advanced version 
x(t + 2) of the CT signal x{t ). 


(b) 



(c) 


Example 1.15 

Consider the signal x[k] defined as follows: 


0.2 k 0 < k < 5 
0 elsewhere. 


(1.52) 


Determine and plot signals p[k] = x[k — 2] and q[k~\ = x[k + 2], 


Solution 

The signal x[k ] is plotted in Fig. 1.24(a). To calculate the expression for p[k], 
substitute k — m— 2 in Eq. (1.52). The resulting equation is given by 

r ^ 0.2(m — 2) 0 < (m — 2) < 5 

X[ "'- 21= 0 elsewhere. 


By changing the independent variable from m to k and simplifying, we obtain 


p[k] = x[k - 2] 


0.2(k - 2) 2 < k < 7 
0 elsewhere. 


The non-zero values of p[k] for —2 < k <7, are shown in Table 1.1, and the 
stem plot p[k] is plotted in Fig. 1.24(b). To calculate the expression for c/[k], 
substitute k = m + 2 in Eq. (1.52). The resulting equation is as follows: 


x[m + 2] = 


0.2 (m + 2) 0 < (m + 2) < 5 
0 elsewhere. 
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(a) 


(b) 


Fig. 1.24. Time shifting of the 
DT sequence in Example 1.15. 

(a) Original DT sequence x[k], 

(b) Time-delayed version 
x[k - 2] of x[A:]. 

(c) Time-advanced version 
x[k + 2] ofx[A:]. 




















1 
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Oi • 1 • • • k 

-4 -2 0 2 4 6 8 10 


(C) 


Table 1.1. Values of the signals p[k] and q[k] 


k -2 -1 0 1 2 3 4 5 6 7 

p[k] 0 0 0 0 0 0.2 0.4 0.6 0.8 1 

q[k] 0 0.2 0.4 0.6 0.8 1 0 0 0 0 


By changing the independent variable from m to k and simplifying, we 
obtain 


q[k\ = x[k + 2] = 


0.2 (k + 2) 

0 


-2 < k < 3 
elsewhere. 


Values of q[k], for —2 < k <7 , are shown in Table 1.1, and the stem plot for 
q[k ] is plotted in Fig. 1.24(c). 

As in Example 1.14, we observe that the waveform for p[k] = x[k — 2] can 
be obtained directly by shifting the waveform of .*[£] towards the right-hand 
side by two time units. Similarly, the waveform for ry[A] = x[k + 2] can be 
obtained directly by shifting the waveform of x[k] towards the left-hand side 
by two time units. 


1.3.2 Time scaling 

The time-scaling operation compresses or expands the input signal in the time 
domain. A CT signal x(t ) scaled by a factor c in the time domain is denoted by 
x(ct). If c > 1, the signal is compressed by a factor of c. On the other hand, if 
0 < c < 1 the signal is expanded. We illustrate the concept of time scaling of 
CT signals with the help of a few examples. 


40 


Part I Introduction to signals and systems 



-4 



-2 


10 


-4 


-2 


10 


(a) 


(b) 


Fig. 1.25. Time scaling of the CT 
signal in Example 1.16. 

(a) Original CT signal x(t). 

(b) Time-compressed version 
x(2t) ofx(t). (c) Time-expanded 
version x(0.5t ) of signal x(t ). 



(c) 


Example 1.16 

Consider a CT signal x(t) defined as follows: 


x(t) = 


t + 1 

-i < t < 

1 

0 < t < 

—t + 3 

2 < t < 


0 elsewhere, 


(1.53) 


as plotted in Fig. 1.25(a). Determine the expressions for the time-scaled signals 
x(2 1) and x(t/2). Sketch the two signals. 


Solution 

Substituting t by 2a in Eq. (1.53), we obtain 


x(2 a) — 


' 2a + 1 
1 

— 2a + 3 
0 


— 1 < 2a < 0 
0 < 2a < 2 
2 < 2a < 3 
elsewhere. 


By changing the independent variable from a to t and simplifying, we obtain 


2t + 1 


x(2t) = 


1 

—2t + 3 

0 


-0.5 < t < 0 
0< t < 1 
1 < t < 1.5 
elsewhere, 


which is plotted in Fig. 1.25(b). The waveform for x(2 1) can also be obtained 
directly by compressing the waveform for x(t) by a factor of 2. It is important 
to note that compression is performed with respect to the v-axis such that the 
values x{t) and x(2 1) at t = 0 are the same for both waveforms. 
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Substituting t by a/2 in Eq. (1.53), we obtain 


x(a/2) — 


' a/2+1 

1 

-a/2 + 3 

0 


-1 < a/2 < 0 
0 < a/2 < 2 
2 < a/2 < 3 
elsewhere. 


By changing the independent variable from a to t and simplifying, we obtain 


x(t/2) = 


' t/ 2+1 

1 

-t / 2 + 3 

0 


-2 < t < 0 
0 < t < 4 
4 < t <6 
elsewhere, 


which is plotted in Fig. 1.25(c). The waveform for x(0.5t) can also be obtained 
directly by expanding the waveform for x(t) by a factor of 2. As for compression, 
expansion is performed with respect to the y-axis such that the values xil) and 
x(t / 2) at t = 0 are the same for both waveforms. 

A CT signal x{t) can be scaled to x(ct) for any value of c. For the DTFT, 
however, the time-scaling factor c is limited to integer values. We discuss the 
time scaling of the DT sequence in the following. 


1 .3.2.1 Decimation 


If a sequence x[k] is compressed by a factor c, some data samples of x\k\ are 
lost. For example, if we decimate .y[£] by 2, the decimated function y[k] = 
x[2k] retains only the alternate samples given by jc [0], x[2\, x[4], and so on. 
Compression (referred to as decimation for DT sequences) is, therefore, an 
irreversible process in the DT domain as the original sequence x[k\ cannot be 
recovered precisely from the decimated sequence y[k\. 


1 .3.2.2 Interpolation 


In the DT domain, expansion (also referred to as interpolation) is defined as 
follows: 


c (m) [k\ = 


- 

" k " 

X 

— 


_m _ 

0 



if k is a multiple of integer m 
otherwise. 


(1.54) 


The interpolated sequence inserts (m — 1) zeros in between adjacent 

samples of the DT sequence x[k]. Interpolation of the DT sequence x[k] is a 
reversible process as the original sequence a [A] can be recovered from x^ m \k}. 


Example 1.17 

Consider the DT sequence x[k] plotted in Fig. 1.26(a). Calculate and sketch 
p[k] = x[2 k] and q[k] = x[k/2]. 
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Table 1.2. Values of the signal p[k] for -3 < k < 3 


k 

-3 

-2 

-1 


0 1 

2 

3 

p[k] 

x[-6] = 0 

x[-4\ = 0.2 

1 4-2] = 

0.6 

40] = 1 42] = 

O 

ON 

II 

0.2 a [6] = 0 

Table 

1.3. Values of the signal q [k] for 

-10 < k < 10 





k 

-10 

-9 

-8 

-7 

-6 

-5 

-4 

q[k] 

T 

LTx 

II 

O 

0 

4-4] = 0.2 

0 

4-3] = 0.4 

0 

a [—2] = 0.6 

k 

-3 

-2 

-1 

0 

1 

2 

3 

q[k ] 

0 

oo 

d 

II 

7 

0 

40] 

= 1 0 

41] = 0.8 

0 

k 

4 

5 

6 

7 

8 

9 

10 

q[k] 

x[2] = 0.6 

0 

43] = 0.4 

0 

a- [4] = 0.2 

0 

a [5] = 0 


1.2 

1 

0.8 

0.6 

0.4 

0.2 











1.2 

1 

0.8 

0.6 

0.4 

0.2 
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(a) (b) 

1 

0.8 

Fig. 1.26. Time scaling of the DT 0.6 

signal in Example 1.17. 0.4 

(a) Original DT sequence x[k], 0.2 





























































\u) L/euiiidieu vemui i j, ui "jq _ 8 _ 6 ^4 _2 0 2 4 6 8 1 

x[k\. (c) Interpolated version 

x[0.5A] of signal x[k\. (c) 


Solution 

Since x[k] is non-zero for — 5 < A < 5, the non-zero values of the decimated 
sequence p[k] = x[2 k] lie in the range — 3 < A < 3. The non-zero values of 
p[k] are shown in Table 1.2. The waveform for p[k] is plotted in Fig. 1.26(b). 

The waveform for the decimated sequence p [A] can be obtained by directly 
compressing the waveform for x[k] by a factor of 2 about the y-axis. While 
performing the compression, the value of a [A] at k = 0 is retained in p[k]. On 
both sides of the A = 0 sample, every second sample of x[k] is retained in p[k]. 
To determine q [A] = x [ k /2] , we first determine the range over which x [A' /2] 
is non-zero. The non-zero values of q[k] — x[k/2\ lie in the range — 10 < k < 
10 and are shown in Table 1.3. The waveform for q[k] is plotted in Fig. 1.26(c). 

The waveform for the decimated sequence q[k] can be obtained by directly 
expanding the waveform for x[k ] by a factor of 2 about the y-axis. During 
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Table 1.4. Values of the signal q 2 [k] for -10 < k < k 


k 

-10 

-9 

-8 

-7 

-6 

-5 

-4 

qi[k] 

4-5] = 0 

0.1 

x[-4] = 0.2 

0.3 

4-3] = 0.4 

0.5 

4-2 ] = 0.6 

k 

-3 

-2 

-1 

0 

1 

2 

3 

q 2 [k ] 

0.7 

OO 

O 

II 

0.9 

40] = 1 

0.9 

OO 

d 

II 

0.7 

k 

4 

5 

6 

7 

8 

9 

10 

qilk] 

x[2] = 0.6 

0.5 

d 

II 

CO 

0.3 

<N 

d 

II 

0.1 

0 

II 

jn 


expansion, the value of x[k] at k = 0 is retained in c/[k]. The even-numbered 
samples, where k is a multiple of 2, of q[k] equal x[k/ 2\. The odd-numbered 
samples in <7 [Ar] are set to zero. 


While determining the interpolated sequence x[mk\, Eq. (1.54) inserts (m — 1) 
zeros in between adjacent samples of the DT sequence x[k], where x[k] is not 
defined. Instead of inserting zeros, we can possibly interpolate the undefined 
values from the neighboring samples where x[k] is defined. Using linear inter- 
polation, an interpolated sequence can be obtained using the following equation: 


x im) [k] = 


x 


k 

m 


" k 


-ki- 

m 

+ OL X 

rn 


if k is a multiple of integer m 
otherwise, 

(1.55) 


where denotes the nearest integer less than or equal to {k/m), denotes 
the nearest integer greater than or equal to (k/m), and a = ( k mod m)/m . Note 
that mod is the modulo operator that calculates the remainder of the division 
k/m. For m = 2, Eq. (1.55) simplifies to the following: 


x (2) [k ] 




if k is even 
if /c is odd. 


Although, Eq. (1.55) is useful in many applications, we will use Eq. (1.54) to 
denote an interpolated sequence throughout the book unless explicitly stated 
otherwise. 


Example 1.18 

Repeat Example 1.17 to obtain the interpolated sequence q 2 [A] = x[k/ 2] using 
the alternative definition given by Eq. (1.55). 


Solution 

The non-zero values of q 2 [k] = x[k/ 2] are shown in Table 1.4, where the val- 
ues of the odd-numbered samples of q 2 [k], highlighted with the gray back- 
ground, are obtained by taking the average of the values of the two neighboring 
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Fig. 1.27. Interpolated version 
x[0.5Ar] of signal x[k], where 
unknown sample values are 
interpolated. 



samples at k and k — 1 obtained from x [k |. The waveform for q 2 [A'] is plotted in 
Fig. 1.27. 


1.3.3 Time inversion 


The time inversion (also known as time reversal or reflection) operation reflects 
the input signal about the vertical axis ( t — 0). When a CT signal x(t) is time- 
reversed, the inverted signal is denoted by x{— t). Likewise, when a DT signal 
x[k\ is time-reversed, the inverted signal is denoted by x[— k]. In the following 
we provide examples of time inversion in both CT and DT domains. 


Example 1.19 

Sketch the time-inverted version of the causal decaying exponential signal 


x(t) = e 'u(t) = 


t > 0 
elsewhere, 


(1.56) 


which is plotted in Fig. 1.28(a). 


Solution 

To derive the expression for the time-inverted signal x(— t), substitute t — —a 
in Eq. (1.56). The resulting expression is given by 


x (—a) = e“n (—a) 


0 


—a > 0 

elsewhere. 


Fig. 1.28. Time inversion of the 
CT signal in Example 1.19. 

(a) Original CT signal x(t). 

(b) Time-inverted version x(-t). 


Simplifying the above expression and expressing it in terms of the independent 
variable t yields 

v(-f) — S ' 1 ~ ^ 

0 elsewhere. 




(a) 


(b) 
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(a) (b) 


Fig. 1.29. Time inversion of the 
DT signal in Example 1.20. 

(a) Original CT sequence x[A]. 

(b) Time-inverted version x[-k]. 


The time-reversed signal x(—t) is plotted in Fig. 1.28(b). Signal inversion can 
also be performed graphically by simply flipping the signal x(t) about the 
y-axis. 


Example 1.20 

Sketch the time-inverted version of the following DT sequence: 


x[k] = 


1 

0.25A 

0 


— 4 < k < — 1 
0 < k < 4 
elsewhere, 


which is plotted in Fig. 1.29(a). 


(1.57) 


Solution 

To derive the expression for the time-inverted signal x[— k], substitute 
k — —m in Eq. (1.57). The resulting expression is given by 


x[— m] 


1 —4 < — m < — 1 

—0.25 m 0 < — m < 4 

0 elsewhere. 


Simplifying the above expression and expressing it in terms of the independent 
variable k yields 


x[—m] 


1 1 < m < 4 

—0.25 m —4 < —m < 0 
0 elsewhere. 


The time-reversed signal x[— A] is plotted in Fig. 1.29(b). 


1.3.4 Combined operations 

In Sections 1 .3. 1-1 .3.3, we presented three basic time-domain transformations. 
In many signal processing applications, these operations are combined. An 
arbitrary linear operation that combines the three transformations is expressed 
as x (at + ft), where a is the time-scaling factor and ft is the time-shifting 
factor. If a is negative, the signal is inverted along with the time-scaling and 
time-shifting operations. By expressing the transformed signal as 


x(at + ft) = x 


(1.58) 
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(a) (b) 



(c) 


(d) 


Fig. 1.50. Combined CT 
operations defined in Example 
1.21. (a) Original CT signal x(t). 

(b) Time-scaled version x(2t). 

(c) Time-inverted version 
x(-2t) of (b). (d) Time-shifted 
version x(4 + 2t ) of (c). 


we can plot the waveform graphically for x(at + /3) by following steps (i)-(iii) 
outlined below. 

(i) Scale the signal x(t) by |a|. The resulting waveform represents jc(|qs | f). 

(ii) If a is negative, invert the scaled signal x{\a\t) with respect to the t — 0 
axis. This step produces the waveform for x(at). 

(iii) Shift the waveform for x(at) obtained in step (ii) by \[1/a \ time units. Shift 
towards the right-hand side if (/i/o') is negative. Otherwise, shift towards 
the left-hand side if (fi/a) is positive. The waveform resulting from this 
step represents x(at + /)), which is the required transformation. 


Example 1.21 

Determine x(4 — 2t), where the waveform for the CT signal x(t) is plotted in 
Fig. 1.30(a). 


Solution 

Express x(4 — 2 1) = x(—2 [t — 2]) and follow steps (i)-(iii) as outlined below. 

(i) Compress x(t ) by a factor of 2 to obtain x(2t). The resulting waveform is 
shown in Fig. 1.30(b). 

(ii) Time-reverse x(2t) to obtain x(—2 1). The waveform for x(—2t) is shown 
in Fig. 1.30(c). 

(iii) Shift x(—2 1) towards the right-hand side by two time units to obtain 
x(—2[t — 2]) = x(4 — 2 1). The waveform for jt(4 — 2 1) is plotted in 
Fig. 1.30(d). 


Example 1.22 

Sketch the waveform for x[— 15 - 3//] for the DT sequence x[k] plotted in 
Fig. 1.31(a). 
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(a) 



(c) 


Fig. 1.31. Combined DT 
operations defined in Example 
1.22. (a) Original DT signal x[Ar]. 

(b) Time-scaled version x[ik}. 

(c) Time-inverted version 
x[-lk] of (b). (d) Time-shifted 
version x [— 15 - 3k] of (c). 



(b) 



(d) 


Solution 

Express x[— 15 - 3k] = x[— 3{k + 5)] and follow steps (i)-(iii) as outlined 

below. 

(i) Compress x[k ] by a factor of 3 to obtain x[3k], The resulting waveform is 
shown in Fig. 1.31(b). 

(ii) Time-reverse x[3&] to obtain x[—3A], The waveform for x[— 3A] is shown 
in Fig. 1.31(c). 

(iii) Shift x[— 3k] towards the left-hand side by five time units to obtain 
x[— 3(h + 5)] = x [— 15 — 3 k]. The waveform for x [— 15 - 3A] is plotted 
in Fig. 1.31(d). 


1.4 Signal implementation with Matlab 


Matlab is used frequently to simulate signals and systems. In this section, 
we present a few examples to illustrate the generation of different CT and DT 
signals in Matlab. We also show how the CT and DT signals are plotted in 
Matlab. A brief introduction to Matlab is included in Appendix E. 

Example 1.23 

Generate and sketch in the same figure each of the following CT signals using 
Matlab . Do not use the “for” loops in your code. In each case, the horizontal 
axis t used to sketch the CT should extend only for the range over which the 
three signals are defined. 

(a) X\(t) — 5 sin(2^f) cos(7rt — 8) for — 5 < t < 5; 

(b) X 2 (t) — 5e~ 0 2 ' sin (2nt) for — 10 < t < 10; 

(c) x 3 (t) = e 0 4lr - a5 > r u(t) for -5 < t < 15. 
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Solution 

The Matlab code for the generation of signals (a)-(c) is as follows: 


>> 

>> 

>> 

>> 

>> 


>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 


>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 


%%%%%%%%%%%% 

% Part (a) % 

%%%%%%%%%%%% 


cl f 

Q. 

"D 

Clear any existing figure 

tl = [-5:0.001:5] ; 

Q. 

"D 

Set the time from -5 to 5 
% with a sampling 


Q. 

"D 

rate of 0.001s 

xl = 5*sin (2*pi*tl ) . 

*cos (pi*tl-8 ) ; 

% plot xl(t) 

Q. 

"D 

compute function xl 

subplot (2,2,1) ; 

Q. 

"O 

select the 1 st out of 4 
% subplots 

plot (tl,xl) ; 

Q. 

"D 

plot a CT signal 

grid on; 

Q. 

"D 

turn on the grid 

xlabel('time ( t ) ' ) ; 

Q. 

"D 

Label the x-axis as time 

ylabel ( ’ 5sin (2\pi t) 
cos (\pi t - 8) ' ) ; 

Q. 

"O 

Label the y-axis 

title ( ' Part (a) ' ) ; 
%%%%%%%%%%%% 

% Part (b) % 

%%%%%%%%%%%% 

Q. 

"D 

Insert the title 

t2 = [-10:0.002:10] ; 

% 

Set the time from -10 to 
% 10 with a sampling 


% 

rate of 0.002s 

x2 = 5*exp (—0.2* t2 ) . 

*sin (2 *pi*t2 ) ; 

% plot x2 (t) 

% 

compute function x2 

subplot (2,2,2) ; 

% 

select the 2 nd out of 4 
% subplots 

plot ( t2 , x2 ) ; 

% 

plot a CT signal 

grid on; 

% 

turn on the grid 

xlabel('time (t)'); 

% 

Label the x-axis as time 

ylabel ( ' 5exp ( — 0 . 2 1 ) 
sin (2\pi t) ' ) ; 

% 

Label the y-axis 

title ( ' Part (b) ' ) ; 
%%%%%%%%%%%% 

%Part (c) % 
%%%%%%%%%%%% 

% 

Insert the title 

t3 = [-5:0.001:15] ; 

% 

Set the time from -5 to 
% 15 with a sampling 


% 

rate of 0.001s 


>> 


49 


1 Introduction to signals 


» x3 = exp ( ( j *4*pi-0 . 5 ) * t3 ) . 
* ( t3>=0 ) ; 

» % plot the real component 
of x3 (t) 

» subplot (2 , 2 , 3 ) ; 

» plot (t3 , real (x3 )) ; 

» grid on; 

» xlabel ( ' time (t) ' ) 

» ylabel ( ' 5exp [ ( j *4\pi-0 . 5) 
t ] u ( t ) ' ) ; 

» title ('Part (c) : Real 
Component ' ) ; 

» subplot (2 , 2 , 4 ) ; 

» plot ( t3 , imag (x3 ) ) ; 

» grid on; 

» xlabel ('time (t) ' ) ; 

» ylabel (' 5exp [ (j 4\pi-0 . 5 ) 
t ] u ( t ) ' ) ; 

» title ('Part (d) : Imaginary 
Component ' ) ; 


% compute function x3 


% select the 3 rd out of 4 
% subplots 
% plot a CT signal 
% turn on the grid 
% Label the x-axis as time 
% Label the y-axis 

% Insert the title 

% select the 4 th out of 4 
% subplots 

% plot the imaginary 

% component of a CT 
% signal 

% turn on the grid 
% Label the x-axis as time 
% Label the y-axis 

% Insert the title 


The resulting Matlab plot is shown in Fig. 1.32. 

Example 1.24 

Repeat Example 1.23 for the following DT sequences: 

(a) /, [k] = -0.92 sin(0.l7rifc - 3 jt/ 4) for - 10 < k < 20; 

(b) f 2 [k] = 2.0(1. l) m — 2.1(0.9) 07 * for —5 < k < 25; 

(c) hlk] = (— 0.93)*e> 7r * / '< /55S for 0 < k < 50. 


Solution 

The Matlab code for the generation of signals (a)-(c) is as follows: 


» %%%%%%%%%%%% 

>> % Part (a) % 

» %%%%%%%%%%%% 

>> elf % clear any existing figure 

>> k = [-10:20]; % set the time index from 

% -10 to 20 

» fl = -0.92 * sin (0 . l*pi*k - 3*pi/4); 

% compute function fl 
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Fig. 1.32. Matlab plot for 
Example 1.23. (a)xi(f); 

(b) x 2 (t); (c) Re{jr 3 (f)}; 
(d) lm{x 3 (f)}. 
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(d) 


>> % plot function 1 

>> subplot (2 , 2 , 1) , stem(k, fl, 'filled'), grid 
>> xlabel ( ' k ' ) 

>> ylabel ( ' -9 . 2sin (0 . l\pi k-0.75\pi') 

>> title ('Part (a)') 

» %%%%%%%%%%%% 

» % Part (b) % 

» %%%%%%%%%%%% 

» k = [-5:25] ; 

» f2 = 2 * 1. 1. ~ (-1. 8*k) - 2.1 * 0.9.~ (0.7*k) ,- 
>> subplot (2 , 2 , 2 ) , stem(k, f2, 'filled'), grid 
>> xlabel ( ' k ' ) 

» ylabel ( ' 2 (1 . 1) "{-l . 8k} - 2 . 1 (0 . 9 ) "0 . 7k' ) 

>> title ('Part (b) ' ) 

» %%%%%%%%%%%% 

>> % Part(c) % 

» %%%%%%%%%%%% 

» k = [0:50] ; 

>> f3 = (—0.93) . ''k .* exp ( j *pi*k/sqrt (350 ) ) ; 

>> subplot (2 , 2 , 3 ) , stem(k, real(f3), 'filled'), grid 
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Fig. 1.33. Matlab plot for 
Example 1.24. 



» xlabel ( 'k' ) 

» ylabel ( ' ( -0 . 93 ) ~k exp(j\pi k/ ( 350 ) "{0 . 5} ' ) 

» title ('Part (c) - real part') 

» % 

» subplot (2 , 2 , 4) , stem(k, imag(f3), 'filled'), grid 
» xlabel ( 'k' ) 

» ylabel ('( -0 . 93 ) ~k exp(j\pi k/ ( 350 ) "{0 . 5} ' ) 

» title ('Part (d) - imaginary part') 

» print -dtiff plot. tiff 

The resulting Matlab plots are shown in Fig. 1.33. 


1.5 Summary 


In this chapter, we have introduced many useful concepts related to signals 
and systems, including the mathematical and graphical interpretations of signal 
representation. In Section 1.1, we classified signals in six different categories: 
CT versus DT signals; analog versus digital signals; periodic versus aperiodic 
signals; energy versus power signals; deterministic versus probabilistic signals; 
and even versus odd signals. We classified the signals based on the following 
definitions. 
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(1) A time-varying signal is classified as a continuous time (CT) signal if it is 
defined for all values of time t. A time-varying discrete time (DT) signal is 
defined for certain discrete values of time, t = kT s , where T s is the sampling 
interval. In our notation, a CT signal is represented by x(t ) and a DT signal 
is denoted by x[k\. 

(2) An analog signal is a CT signal whose amplitude can take any value. A 
digital signal is a DT signal that can only have a discrete set of values. 
The process of converting a DT signal into a digital signal is referred to as 
quantization. 

(3) A periodic signal repeats itself after a known fundamental period, i.e. 
x{t) = x(t + 7o)forCT signals and x[k] = x[k + Kq] forDT signals. Note 
that CT complex exponentials and sinusoidal signals are always periodic, 
whereas DT complex exponentials and sinusoidal signals are periodic only 
if the ratio of their DT fundamental frequency Co, to 2i r is a rational 
number. 

(4) A signal is classified as an energy signal if its total energy has a non-zero 
finite value. A signal is classified as a power signal if it has non-zero finite 
power. An energy signal has zero average power whereas a power signal 
has an infinite energy. Periodic signals are generally power signals. 

(5) A deterministic signal is known precisely and can be predicted in advance 
without any error. A random signal cannot be predicted with 100% 
accuracy. 

(6) A signal that is symmetric about the vertical axis (t = 0) is referred to 
as an even signal. An odd signal is antisymmetric about the vertical axis 
(f = 0). Mathematically, this implies x(t) = x(—t) for the CT even signals 
and x(t) = —x(—t) for the CT odd signals. Likewise for the DT signals. 

In Section 1.2, we introduced a set of ID elementary signals, including rectan- 
gular, sinusoidal, exponential, unit step, and impulse functions, defined both in 
the DT and CT domains. We illustrated through examples how the elementary 
signals can be used as building blocks for implementing more complicated sig- 
nals. In Section 1.3, we presented three fundamental signal operations, namely 
time shifting, scaling, and inversion that operate on the independent variable. 
The time-shifting operation x(t — T) shifts signal x(t) with respect to time. 
If the value of T in x(t — '/') is positive, the signal is delayed by T time 
units. For negative values of T , the signal is time-advanced by T time units. 
The time-scaling, x(ct), operation compresses (c > 0) or expands (c < 0) sig- 
nal x{t). The time-inversion operation is a special case of the time-scaling 
operation with c = — 1. The waveform for the time-scaled signal x(—t) is the 
reflection of the waveform of the original signal x{t) about the vertical axis 
(t = 0). The three transformations play an important role in the analysis of lin- 
ear time-invariant (LTI) systems, which will be covered in Chapter 2. Finally, 
in Section 1.4, we used Matlab to generate and analyze several CT and DT 
signals. 
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Problems 


1.1 For each of the following representations: 

(i) z[m,n,k], 

(ii) I(x,y,z,t), 

establish if the signal is a CT or a DT signal. Specify the independent 
and dependent variables. Think of an information signal from a physical 
process that follows the mathematical representation given in (i). Repeat 
for the representation in (ii). 

1.2 Sketch each of the following CT signals as a function of the independent 
variable t over the specified range: 

(i) xl (t) = cos( 37T?/4 + ;r/8) for — 1 < t < 2; 

(ii) x2(t) = sin(— 3nt /% + n/2) for — 1 < t < 2; 

(iii) x3(t) = 5 1 + 3 exp (— f) for —2 < t < 2; 

(iv) x4 (t) = (sin(3jrr/4 + jr/8)) 2 for - 1 < t < 2; 

(v) x5(t) = cos(37rf/4) + sin(7rr/2) for —2 < t < 3; 

(vi) x6 (0 = t exp(— 2t) for —2 < t < 3. 

1.3 Sketch the following DT signals as a function of the independent variable 
k over the specified range: 

(i) xl[£] = cos(37r£/4 + 7r/8) for— 5 < k <5; 

(ii) x2[k] = sin(— 37 t£/8 + n/2) for - 10 < k < 10; 

(iii) x3[A-] = 5k + 3~ k for -5 < k < 5; 

(iv) x4[k] = |sin(37rA'/4 + tt/ 8)| for —6 < k < 10; 

(v) x5[A'] = cos(37rA'/4) + sin(7r£/2) for — 10 < k < 10; 

(vi) x6 [A] = k4~W for - 10 < k < 10. 

1.4 Prove Proposition 1.2. 

1.5 Determine if the following CT signals are periodic. If yes, calculate the 
fundamental period Tq for the CT signals: 

(i) x\(t) — sin(— 5nt /8 + n/2); 

(ii) x2(t) — |sin(— 5nt /8 + n/ 2)|; 

(iii) x3(t) — sin(6nt/7) + 2cos(3t/5); 

(iv) x4(t) = exp(j(5r + n/ 4)); 

(v) x5(t) — exp(j3^'/‘/8) + exp(;rf/86); 

(vi) x6 (t) — 2 cos(4nt/5)* sin 2 (16/‘/3); 

(vii) xl (t) — 1 + sin20r + cos(30r + n/3). 

1.6 Determine if the following DT signals are periodic. If yes, calculate the 
fundamental period No for the DT signals: 

(i) xl[A] = 5x(— 1)*; 

(ii) x2[k] = exp()(lnk/4)) + exp(j(3A/4)); 

(iii) x3[A] = exp(j'(77rA/4)) + exp(j(37rA74)); 

(iv) x4[k] = sin(37rA/8) + cos(63^"A764); 
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(v) *5[A] = exp(j(7;rA/4)) + cos(4;rA/7 + 7r); 

(vi) x6 [A] = sin(37rA/8) cos(637rA/64). 

1.7 Determine if the following CT signals are energy or power signals or 
neither. Calculate the energy and power of the signals in each case: 


(i) x\{t) = cos(^/) sin(37r/); 

(ii) x2(t) = exp(— 2t)\ 

(iii) x3(t) = exp(— j2f); 

(iv) x4{t) = exp(— 2 t)u(t); 


(v) *5(f) = 


(vi) *6(0 = 


cos(37r t ) — 3 < t < 3; 


0 
' t 
4 
0 


elsewhere; 
0 < t < 2 
2 < t < 4 
elsewhere. 


1.8 Repeat Problem 1.7 for the following DT sequences: 

(jxk\ /3ttA n 
(i) xl[A] — cos I — I sin I — 


(ii) x2[k] = 


' 

(3itk\ 

COS 1 
0 

Cm) 


-10 < k < 0 
elsewhere; 


(iii) x3[k] = (-l)Y 

(iv) x4[k] = exp(j(7rA/2 + jt/8)); 

2 k 0 < A < 10 

(v) *5 [A] = 1 11 < A < 15 

0 elsewhere. 

1.9 Show that the average power of the CT periodic signal x(t) = Asin(&>o? - 
0), with real-valued coefficient A, is given by A 2 / 2. 

1.10 Show that the average power of the CT signal y(t) — Ai sinirwi t + </q) - 
A 2 sin(o> 2 t + (pi), with real-valued coefficients A i and A 2 , is given by 


Py = 


A 2 


^2 


2 2 
A 2 A 2 

-y + ^ + A 1 A 2 cos (0! 


a> 1 / a> 2 
(pi) (Oi — ®2- 


1.11 Show that the average power of the CT periodic signal x(t) = 
D exp[j(a>of + 0)] is given by |D| 2 . 

1.12 Show that the average power of the following CT signal: 


x(t) = D„e■ , ' u "^ (o p ± co r if p ± r, 

n = 1 

for 1 < p, r < N , is given by 

P x = J2\Dn\ 2 . 

n= 1 

1.13 Calculate the average power of the periodic function shown in Fig. PI . 1 3 
and defined as 

i 2" 2m ” 1 < t < 2~ lm 

0 2~ 2m ~ 2 < t < 


*(t)L=(0,l] = 


m e Z + and x(t) = x(t + 1). 
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Fig. Pl.l 5. The CT function x(t) 
in Problem 1.13. 



(vi) x6(t) = 


1.14 Determine if the following CT signals are even, odd, or neither even nor 
odd. In the latter case, evaluate and sketch the even and odd components 
of the CT signals: 

(i) xl(f) = 2sin(27rr)[2 + cos(4:/rr)]; 

(ii) x2 (t) = t 2 + cos(3 1); 

(iii) x3(f) = exp(— 3t) sin(37rf); 

(iv) x4 (t) = t sin(5t); 

(v) x5(t) = tu(t)\ 

3t 0 < t < 2 

6 2 < t < 4 

3(—t + 6) 4 < / < 6 

0 elsewhere. 

1.15 Determine if the following DT signals are even, odd, or neither even nor 
odd. In the latter case, evaluate and sketch the even and odd components 
of the DT signals: 

(i) xl [k] = sin(4k) + cos(2;r/k3); 

(ii) x2[k] — sin(7rk/3000) + cos(2jtk/3 ); 

(iii) x3 [k] — exp(j(7jrk/4)) + cos(47rk/7 + tt); 

(iv) x4[k] — sin(3jrk/8) cos(637r^/64); 

(-1/' k > 0 

0 k < 0. 


(v) x5[k] = 


1.16 Consider the following signal: 


x(t) = 3 sin 


2n(t - T) 


Determine the values of T for which the resulting signal is (a) an even 
function, and (b) an odd function of the independent variable t. 

1.17 By inspecting plots (a), (b), (c), and (d) in Fig. PI. 17, classify the CT 
waveforms as even versus odd, periodic versus aperiodic, and energy 
versus power signals. If the waveform is neither even nor odd, then deter- 
mine the even and odd components of the signal. For periodic signals, 
determine the fundamental period. Also, compute the energy and power 
present in each case. 

1.18 Sketch the following CT signals: 

(i) xl(f) = w(f) + 2 u(t — 3) — 2u(t — 6) — u(t — 9); 

(ii) x2(t) = w(sin(7rt)); 
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-4 -3 -2 -1 

(a) 


-4 -3 -2 -1 

(c) 

Fig. PI. 17. Waveforms for 
Problem 1.17. 



(iii) *3 (t) = rect(f/6) + rect(f/4) + rect(r/2); 

(iv) x4 (r) = r(t) — r(t — 2) — 2 u(t — 4); 

(v) x5 (?) = (exp(— t) — exp(— 3 t))u(t)\ 

(vi) *6 (?) = 3 sgn(0 ■ rect(r/4) + 2 S(t + 1) — 3 S(t — 3). 

1.19 (a) Sketch the following functions with respect to the time variable (if 
a function is complex, sketch the real and imaginary components sep- 
arately). (b) Locate the frequencies of the functions in the 2D complex 
plane. 

(i) xl (r) = e j27rf+3 ; 

(ii) x2(t) = 

(iii) *3(0 = 

(iv) *4(0 = cos(2 ii t + 3); 

(v) *5(0 = cos(27 Tt + 3) + sin(3^'/‘ + 2); 

(vi) *6(0 = 2 + 4 cos(2;/rf + 3) — 7 sin(57r? + 2). 

1.20 Sketch the following DT signals: 

(i) *l[/c] = u[k] + u[k - 3] - u[k - 5] - u[k - 7]; 

OO 

(ii) *2 [k] = ^ «$ [it - m]; 

m = 0 

(iii) *3[/c] = ( 3 k - 2 k )u[k]- 

(iv) *4[/c] = m[cos(7tA78)]; 

(v) x5[k] = ku[k]\ 

(vi) *6[/c] = |/t] (u[k + 4] - u[k - 4]). 

1.21 Evaluate the following expressions: 

5 + 2 t + t 2 
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1.22 Evaluate the following integrals: 

OO 

(i) j (f - l)S(t - 5)dr; 


— OO 
6 


(ii) J (r - l)<5(r - 5)dr; 

— OO 
OO 

(iii) J (t- 1 )8(t - 5)d t; 


(iv) 


OO 

J (2f/3 — 5)<5(3r/4 — 5 / 6)dr ; 

— OO 
OO 

/ 


(v) J exp(r — 1 ) sin(7r(r + 5)/4)<5(l — r)dr ; 

— OO 
OO 

(vi) J [sin(3:rf/4) + exp(— 2r + 1 )]<$(— t — l)d?; 

— OO 
OO 

(vii) J [u(t — 6) — u(t — 10)] sin(37Tf/4)<5(f — 5)df; 


— OO 
21 


(vii,) / ( ± 

-21 ' m= ~ X 


t8(t — 5m) ] dr. 


1.23 In Section 1.2.8, the Dirac delta function was obtained as a limiting case of 

1 / 1 \ 

the rectangular function, i.e. 8(t) = lim - rect I - I . Show that the Dirac 

e-s-O s \S J 

delta function can also be obtained from each of the following functions 
(i.e. that Eq. (1.43) is satisfied by each of the following functions): 
e i 

7t(t 2 + e 2 )’ (iii) lim — sin er; 

£ — m nt 


(ii) lim 


2e 


£—>0 4jT 2 t 2 + s 2 ’ 


1.24 Consider the following signal: 


(iv) lim 


1 


o eV 2: 


x(t) = 


t + 2 

1 

-r + 2 
0 


j r 


-2 < t < -1 
-1 < t < 1 
1 < t < 2 
elsewhere. 


exp 


r / 

'Ye 2 )' 


(a) Sketch the functions: (i) x(t — 3); (ii) x(—2 1 — 3); (iii) x(—2t — 3); 
(iv) x(— 0.75r - 3). 

(b) Determine the analytical expressions for each of the four functions. 
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Fig. PI. 25. Waveform for 
Problem 1.25. 


Fig. PI. 26. Waveform for 
Problem 1.26. 


Fig. PI. 27. Waveform for 
Problem 1.27. 


fit) 



fit) 

2 

: I ■ i I ! I I I j ► t 

-4 -3 -2 -1 0 1 2 3 4 


1.25 Consider the function fit) shown in Fig. PI. 25. 

(i) Sketch the function g(t) — f(—3t + 9). 

(ii) Calculate the energy and power of the signal fit). Is it a power signal 
or an energy signal? 

(iii) Repeat (ii) for git). 

1.26 Consider the function fit) shown in Fig. PI. 26. 

(i) Sketch the function git) — /(— 2t + 6). 

(ii) Represent the function fit) as a summation of an even and an odd 
signal. Sketch the even and odd parts. 

1.27 Consider the function fit) shown in Fig. PI. 27. 

(i) Sketch the function git) — tfit + 2) — tfit — 2). 

(ii) Sketch the function gilt). 

1.28 Consider the two DT signals 

x\[k] = \k\iu[k + 4] - u[k - 4]) 


and 


x 2 [k] = kiu[k + 5]-u[k-5]). 
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Fig. P1.29. ECG pattern tor 
Problem 1.29. 



Sketch the following signals expressed as a function of X\[k] and x 2 [k]: 


a) xm. 

(vi) x 2 [3 *]; 

(ii) x 2 [k]- 

(vii) Xi[A-/2]; 

(hi) ai[3 -*]; 

(viii) X] [2k] + x 2 [3 £]; 

(iv) Xi[6-2 *]; 

(ix) Xi[3 — k]x 2 [6 — 

(v) xi [2 *]; 

(x) xi[2 k]x 2 [-k]. 


1.29 In most parts of the human body, a small electrical current is often pro- 
duced by movement of different ions. For example, in cardiac cells the 
electric current is produced by the movement of sodium (Na + ) and potas- 
sium (K + ) ions (during different phases of the heart beat, these ions enter 
or leave cells). The electric potential created by these ions is known as an 
ECG signal, and is used by doctors to analyze heart conditions. A typical 
ECG pattern is shown in Fig. PI. 29. 

Assume a hypothetical case in which the ECG signal corresponding to 
a normal human is available from birth to death (assume a longevity of 
80 years). Classify such a signal with respect to the six criteria mentioned 
in Section 1.1. Justify your answer for each criterion. 

1.30 It was explained in Section 1.2 that a complicated function could be 
represented as a sum of elementary functions. Consider the function f(t ) 
in Fig. PI. 26. Represent f(t) in terms of the unit step function u(t) and 
the ramp function r(t). 

1.31 (Matlab exercise) Write a set of M ATLAB functions that compute and 
plot the following CT signals. In each case, use a sampling interval of 
0.001 s. 
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(i) x(t ) = exp(— 2t) sin(lO^r) for |r| < 1. 

(ii) A periodic signal x(t ) with fundamental period T — 5. The value 
over one period is given by 

x(t) = 5 1 0 < t < 5. 


Use the sawtooth function available in Matlab to plot five 
periods of x(t) over the range — 10 < t < 15. 

(iii) The unit step function u(t ) over [—10, 10] using the sign function 
available in Matlab. 

(iv) The rectangular pulse function rect(t) 


rect 



1 -5 <t <5 

0 elsewhere 


using the unit step function implemented in (iii). 

(v) A periodic signal x(t) with fundamental period T — 6. The value 
over one period is given by 


x(t ) = 


3 

0 


\t\ < 1 
1 < ]f| <3. 


Use the square function available in Matlab . 


1.32 (Matlab exercise) Write a Matlab function mydecimate with the 
following format: 


function [y] = mydecimate (x, M) 

% MYDECIMATE: computes y[k] = x[kM] 

% where 

% x is a column vector containing the DT input 
% signal 

% M is the scaling factor greater than 1 
% y is a column vector containing the DT output time 
% decimated by M 


In other words, mydecimate accepts an input signal r [A] and produces 
the signal y[A] = x[kM~). 

1.33 (Matlab exercise) Repeat Problem 1.30 for the transformation y[A] = 
x[k/N]. In other words, write a Matlab function myinterpolate 
with the following format: 


function [y] = myinterpolate (x, N) 

% MYINTERPOLATE: computes y[k] = x[k/N] 

% where 

% x is a column vector containing the DT input 
% signal 

% N is the scaling factor greater than 1 
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% y is a column vector containing the DT output 
% signal time expanded by N 

Use linear interpolation based on the neighboring samples to predict any 
required unknown values in x[k], 

1.34 (Matlab exercise) Construct a DT signal given by 

x[k] = (1 - e" 0003 *) cos(?rk/20) for 0 < k < 120. 

(i) Sketch the signal using the stem function. 

(ii) Using the mydecimate (Problem PI. 30) and myinterpolate 
(Problem P1.31) functions, transform the signal x[k] based on the 
operation y [k ] = x[k/ 5] followed by the operation z[k] = y |5C| . 
What is the relationship between x[k] and z[k]? 

(iii) Repeat (ii) with the order of interpolation and decimation reversed. 


CHAPTER 



Introduction to systems 


In Chapter 1 , we introduced the mathematical and graphical notations for repre- 
senting signals, which enabled us to illustrate the effect of linear time operations 
on transforming the signals. A second important component of signal process- 
ing is a system that usually abstracts a physical process. Broadly speaking, a 
system is characterized by its ability to accept a set of input signals Xj, for i e 
{1,2, ... ,m}, and to produce a set of output signals y ; , for j e { 1 , 2, in 
response to the input signals. In other words, a system establishes a relationship 
between a set of inputs and the corresponding set of outputs. 

Most physical processes are modeled by multiple-input and multiple-output 
(MIMO) systems of the form illustrated in Fig. 2.1(a), where the x, (f)’s repre- 
sent the CT inputs while the y 7 (f)’s represent the CT outputs. Such systems, 
which operate on CT input signals transforming them to CT output signals, 
are referred to as CT systems. Using the principle of superimposition, a linear 
MIMO CT system is often approximated by a combination of several single- 
input CT systems. The block diagram representing a single-input, single-output 
CT system is illustrated in Fig. 2.1(b). Throughout this book, we will restrict 
our discussion to the analysis and design of single-input, single-output sys- 
tems, knowing that the principles derived for such systems can be generalized 
to MIMO systems. 

In comparison to CT systems, DT systems transform DT input signals, often 
referred to as sequences, into DT output signals. Two DT systems are shown in 
Fig. 2.2. In Fig. 2.2(a), the schematic of a MIMO DT system is illustrated with 
a set of m input sequences, denoted by x, [k]’s, and a set of n output sequences, 
denoted by y ; [C|’s. A single-input, single-output DT system is illustrated in 
Fig. 2.2(b). As for the CT systems, we will focus on single-input, single-output 
DT systems in this book. 

The relationship between the input signal and its output response of a single- 
input, single-output system, may it be DT or CT, will be shown by the following 
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Fig. 2.1. General schematics of CT systems, (a) Multiple-input, multiple-output (MIMO) CT system with m 
inputs and n outputs, (b) Single-input, single-output CT system. 
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Fig. 2.2. General schematics of 
DT systems, (a) Multiple-input, 
multiple-output (MIMO) DT 
system with m inputs and n 
outputs, (b) Single-input, 
single-output DT system. 


notation: 

CT system x(t) — > y(t)\ (2.1) 

DT system x[k\ —> y[k\. (2.2) 

The arrow in Eq. (2.1) implies that a CT signal x(t), applied at the input of a 
CT system, produces a CT output y(t). Likewise, the arrow in Eq. (2.2) implies 
that a DT input signal x\k\ produces a DT output signal y[k\. This chapter 
focuses on the classification of CT and DT systems. Before proceeding with 
the classification of systems, we consider several applications of signals and 
systems in electrical networks, electronic devices, communication systems, and 
mechanical systems. 

The organization of Chapter 2 is as follows. In Section 2.1, we provide 
several examples of CT and DT systems. We show that most CT systems can be 
modeled by linear, constant-coefficient differential equations, while DT systems 
can be modeled by linear, constant-coefficient difference equations. Section 2.2 
introduces several classifications for CT and DT systems based on the properties 
of these systems. A particularly important class of systems, referred to as linear 
time-invariant (LTI) systems, consists of those that satisfy both the linearity and 
time-invariance properties. Most practical structures are complex and consist 
of several LTI systems. Section 2.3 presents the series, parallel, and feedback 
configurations used to synthesize larger systems. Section 2.4 concludes the 
chapter with a summary of the important concepts. 


2.1 Examples of systems 


In this section, we present examples of physical systems and derive relationships 
between the input and output signals associated with these systems. For linear 
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CT systems, a linear, constant-coefficient differential equation is often used to 
specify the relationship between its input x(t ) and output y(t). For linear DT 
systems, a linear, constant-coefficient difference equation often describes the 
relationship between its input x[k] and output y[k]. The relationship between 
the input and output signals completely specifies the physical system. In other 
words, we do not require any other information to analyze the system. Once the 
input/output relationship has been determined, the schematics of Figs. 2.1(b) 
or 2.2(b) can be applied to model the physical system. 


2.1.1 Electrical circuit 


Figure 2.3 shows a simple electrical circuit comprising of three components: a 
resistor R, an inductor L, and a capacitor C . A voltage signal v(t), applied at 
the input of the circuit, produces an output signal y(t) representing the voltage 
across capacitor C . In order to derive a relationship between the input and 
output signals in the RLC circuit, we make use of the Kirchhoff’s current law, 
which states “The sum of the currents flowing into a node equals the sum of the 
currents flowing out of the node.” 

We apply Kirchhoff’s current law to node 1, shown in the top branch of the 
RLC circuit in Fig. 2.3. The equations for the currents flowing out of node 1 
along resistor R , inductor L, and capacitor C, are given by 


resistor R 

. _ y(t) - v(t) 
' R R 

(2.3a) 

inductor L 

II = j- J y(r)dr 

(2.3b) 


—CO 


capacitor C 

dv 

l c = C — . 
d t 

(2.3c) 


Applying Kirchhoff’s current law to node 1 and summing up all the currents 
yields 


y{t) 


— v(t) 1 f dy 

R + L I y( ' Z ^ dT + C dt = °’ 


(2.4) 


which reduces to a linear, constant-coefficient differential equation of the second 
order, given by 


d 2 y 1 dy 
d f 2 + RCdi 


1 1 dv 

y(t) = . 

LC RC dr 


(2.5) 


In conjunction with the initial conditions, y(0) and y(0), Eq. (2.5) completely 
specifies the relationship between the input voltage v(f) and the output voltage 
y(f) for the RLC circuit shown in Fig. 2.3. 
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Fig. 2.3. Electrical circuit 
consisting of three passive 
components: resistor R, 
capacitor C, and inductor L. The 
RLC circuit is an example of a CT 
linear system. 


node 1 



2.1.2 Semiconductor diode 

When a piece of an intrinsic semiconductor (silicon or germanium) is doped 
such that half of the piece is of n type while the other half is of p type, a pn 
junction is formed. Figure 2.4(a) shows a pn junction with a voltage v applied 
across its terminals. The pn junction forms a basic diode, which is fundamental 
to the operation of all solid state devices. The symbol for a semiconductor diode 
is shown in Fig. 2.4(b). A diode operates under one of the two bias conditions. 
It is said to be forward biased when the positive polarity of the voltage source 
v is connected to the p region of the diode and the negative polarity of the 
voltage source v is connected to the n region. Under the forward bias condition, 
the diode allows a relatively strong current i to flow across the pn junction 
according to the following relationship: 

i = / s [exp(v/V r )-l] (2.6) 

where I s denotes the reverse saturation current, which for a silicon doped diode 
is a constant given by / s = 4.2 x I0 ,s A, and Vj is the voltage equivalent of 
the diode’s temperature. The voltage equivalent Vy is given by 

kT 

V T = —. (2.7) 

e 


Fig. 2.4. Semiconductor diode: 
(a) pn junction in the forward 
bias mode; (b) diode 
representing the pn junction 
shown in (a); (c) current-voltage 
characteristics of a 
semiconductor diode. 



+ v - 




(a) 


(b) 


(c) 
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In Eq. (2.7), the Boltzmann constant k equals 1.38 x 10 -23 joules/kelvin, T 
is the absolute temperature measured in kelvin, and e is the negative charge 
contained in an electron. The value of e is 1.6 x 10~ 19 coulombs. At room 
temperature, 300 K, the value of the voltage equivalent Vj, computed using 
Eq. (2.7), is found to be 0.026 V. Substituting the values of the saturation 
current / s and the voltage equivalent Vj , Eq. (2.6) simplifies to 

i = 4.2 x 10~ 15 [exp(v/0.026) — 1] A = 0.0042[exp(38.61v) - l]pA, (2.8) 

which describes the relationship between the forward bias voltage v and the 
current / flowing through the semiconductor diode. Equation (2.8) is plotted in 
the first quadrant (v > 0 and i > 0) of Fig. 2.4(c). 

In the reverse bias condition, the negative polarity of the voltage source is 
applied to the p region of the diode and the positive polarity is applied to the 
n region. When the diode is reverse biased, the current through the diode is 
negligibly small and is given by its saturation value, 7 S = 4.2 x 1 0 1 3 A. The 
current-voltage relationship of a reverse biased diode is plotted in the third 
quadrant (v < 0 and i < 0) of Fig. 2.4(c), where we observe a relatively small 
value of current flowing through the diode. 

As illustrated in Fig. 2.4(c), the input-output relationship of a semiconductor 
diode is highly non-linear. Compared to the linear electrical circuit discussed 
in Section 2.1.1, such non-linear systems are more difficult to analyze and are 
beyond the scope of this book. 


2.1.3 Amplitude modulator 

Modulation is the process used to shift the frequency content of an information- 
bearing signal such that the resulting modulated signal occupies a higher fre- 
quency range. Modulation is the key component in modern-day communication 
systems for two main reasons. One reason is that the frequency components 
of the human voice are limited to a range of around 4 kHz. If a human voice 
signal is transmitted directly by propagating electromagnetic radio waves, the 
communication antennas required to transmit and receive these radio signals 
would be impractically long. A second reason for modulation is to allow for 
simultaneous transmission of several voice signals within the same geographic 
region. If two signals within the same frequency range are transmitted together, 
they will interfere with each other. Modulation provides us with the means of 
separating the voice signals in the frequency domain by shifting each voice 
signal to a different frequency band. There are different techniques used to 
modulate a signal. Here we introduce the simplest form of modulation referred 
to as amplitude modulation (AM). 

Consider an information-bearing signal m(t) applied as an input to an AM 
system, referred to as an amplitude modulator. In communications, the input 
m(t) to a modulator is called the modulating signal, while its output s(t) is 
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Fig. 2.5. Amplitude modulation 
(AM) system. 



called the modulated signal. The steps involved in an amplitude modulator 
are illustrated in Fig. 2.5, where the modulating signal m(t) is first processed 
by attenuating it by a factor k and adding a dc offset such that the resulting 
signal (1 + km(t )) is positive for all time t. The modulated signal is produced 
by multiplying the processed input signal (1 + km{t)) with a high-frequency 
carrier c(t ) = A cos(2:r f c t). Multiplication by a sinusoidal wave of frequency 
/ c shifts the frequency content of the modulating signal m(t) by an additive 
factor of f c . Mathematically, the amplitude modulated signal s(t) is expressed as 
follows: 


s(t) = A[ 1 + km(t)] cos(27r/ c f), (2.9) 

where A and f c are, respectively, the amplitude and the fundamental frequency 
of the sinusoidal carrier. 

It may be noted that the amplitude A and frequency f c of the carrier signal, 
along with the attenuation factor k used in the modulator, are fixed; therefore, 
Eq. (2.9) provides a direct relationship between the input and the output signals 
of an amplitude modulator. For example, if we set the attenuation factor k to 
0.2 and use the carrier signal c(t) = cos(2jt x I (ft), Eq. (2.9) simplifies to 

s(t ) = [1 + 0.2m(0] cos(2jt x 10 8 r). (2.10) 

Amplitude modulation is covered in more detail in Chapter 7. 


2.1.4 Mechanical water pump 

The mechanical pump shown in Fig. 2.6 is another example of a linear CT 
system. Water flows into the pump through a valve V 1 controlled by an electrical 
circuit. A second valve V2 works mechanically as the outlet. The rate of the 
outlet flow depends on the height of the water in the mechanical pump. A 
higher level of water exerts more pressure on the mechanical valve V2, creating 
a wider opening in the valve, thus releasing water at a faster rate. As the level 
of water drops, the opening of the valve narrows, and the outlet flow of water is 
reduced. 

A mathematical model for the mechanical pump is derived by assuming that 
the rate of flow F m of water at the input of the pump is a function of the input 
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Fig. 2.6. Mechanical water 
pumping system. 



T 

h(t) 

± 


V2 


: ch{t) 


voltage x(t ): 


F m = kx(t), (2.11) 

where k is the linearity constant. Valve V2 is designed such that the outlet flow 
rate F oat is given by 


F oat = ch(t), (2.12) 

where c denotes the outlet flow constant and h(t) is the height of the water 
level. Denoting the total volume of the water inside the tank by V it), the rate 
of change in the volume of the stored water is dV /dr, which must be equal to 
the difference between the input flow rate, Eq. (2.1 1), and the outlet flow rate, 
Eq. (2.12). The resulting equation is as follows: 

= F in - ^out = kx(t) - chit). (2.13) 

dr 

Expressing V ( t ) as the product of the cross-sectional area A of the water tank 
and the height h{t) of the water yields 

d h 

A t - ch(t) = kx(t), (2.14) 

dr 

which is a first-order, constant-coefficient differential equation describing the 
relationship between the input current signal x(t ) and height h(t) of water in 
the mechanical pump. It may be noted that the input-output relationship in 
the electrical circuit, discussed in Section 2.1.1, was also a constant-coefficient 
differential equation. In fact, most CT linear systems are often modeled with 
linear, constant-coefficient differential equations. 


2.1.5 Mechanical spring damper system 

The spring damping system shown in Fig. 2.7 is another classical example of a 
linear mechanical system. An application of such a mechanical damping system 
is in the shock absorber installed in an automobile. Figure 2.7 models a spring 
damping system where mass M, which is attached to a rigid body through a 
mechanical spring with a spring constant of k, is pulled downward with force 
x(t). Assuming that the vertical displacement from the initial location of mass 
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Fig. 2.7. (a) Mechanical spring 
damper system, (b) Free-body 
diagram illustrating the 
opposing forces acting on mass 
M of the mechanical spring 
damping system. 


M is given by y(t), the three upward forces opposing the external downward 
force x(t) are given by 


inertial (or accelerating) force 

d 2 y 

Fi = M-A; 
dr 2 

(2.15a) 

frictional (or damping) force 

F dy 

Ff = r — ; 
dr 

(2.15b) 

spring (or restoring) force 

F s = bit), 

(2.15c) 


where r is the damping constant for the medium surrounding the mass. Apply- 
ing Newton’s third law of motion, the input-output relationship of the spring 
damping system is given by 

d2 j 

M-^+r-f+ky(t) = x(t), (2.16) 

dr- dr 

which is a linear, constant-coefficient second-order differential equation. 
Equation (2.16) describes the relationship between the applied force x(t ) and 
the resulting vertical displacement y(t). As in the case of the RLC circuit, 
a second-order differential equation is used to model the mechanical spring 
damper system. 


2.1.6 Numerical differentiation and integration 


x(t) 

(a) 

x(t) 



(b) 


Fig. 2.8. Schematics of (a) a 
differentiator and (b) an 
integrator. Finite-difference 
schemes are often used to 
compute the values of 
derivatives and finite integrals 
numerically. 


Numerical methods are widely used in calculus for finding approximate values 
of derivatives and definite integrals. Here, we present examples of differentiation 
and integration of a CT function x(t). The systems representing integration and 
differentiator are shown in Fig. 2.8. We show that the numerical approximations 
of a CT differentiator and integrator lead to finite difference equations that are 
frequently used to describe DT systems. 

To discretize a derivative over a continuous interval [0, T], the time interval 7 
is divided into intervals of duration At, resulting in the sampled values x(kAt) 
for k = 0, 1.2,..., K , with K given by the ratio T /At. Using a single-step 
backward finite-difference scheme, the time derivative can be approximated as 
follows: 


which yields 


or, 


dx 


d t 


t=kAt 


x(kAt) — x((k — l)Ar) 
At 


y(kAt) = 


x(kAt) — x((k — l)Ar) 
At 


(2.17) 


(2.18) 


y(kAt) — C\(x(kAt) — x((k — l)Af)), (2.19) 

where x(kAt) is the sampled value of x(t) at t — kAt and Ci is a constant, equal 
to 1/ At . The CT signal y(t ) = dx /dr and represents the result of differentiation. 


70 


Part I Introduction to signals and systems 


Usually, the sampling interval At in Eq. (2.19) is omitted, resulting in the 
following expression: 


y[k] =C l x[k]-C l x[k- 1], (2.20) 


which is a finite-difference representation of the differentiator shown in 
Fig. 2.8(a). 

To integrate a function, we use Euler’s formula, which approximates the 
integral by the following: 

kAt 

j x{t)dt ss Atx{{k — l)At). (2.21) 

(A--l)Ar 


In other words, the area under x(t ) within the range | (k — I )At. kAt] is approx- 
imated by a rectangle with width At and height x((k — I ) At j. Expressing the 
integral as follows: 


y(t)\,=kAt 


J x{t)dt = 
0 


(k-l)At 

I x{t)dt 
o 

?((*-!) A/) 


kAt 


/ 


x(t)dt 


(jfc-l)Ar 


Atx((k—l)At) 


and simplifying, we obtain 


(2.22) 


y(kAt) = y((k - 1)A t) + A tx((k - 1)A t). (2.23) 

Again, omitting the sampling interval At in Eq. (2.23) yields 


y[k] - y[k - 1] = C 2 x[k - 1], (2.24) 


where Ci = At. Equation (2.24) is a first-order finite-difference equation mod- 
eling an integrator and can be solved iteratively to compute the integral at 
discrete time instants kAt. Systems represented by finite-difference equations 
of the form of Eqs. (2.20) or (2.24) are referred to as DT systems and are the 
focus of our discussion in the second half of the book. In the case of DT systems, 
a difference equation, along with the ancillary conditions, provides a complete 
description of the DT systems. 


2.1.7 Delta modulation 


In a digital communication system, the information-bearing analog signal is 
first transformed into a binary sequence of zeros and ones, referred to as a dig- 
ital signal, which is then transferred using a digital communication technique 
from a transmitter to a receiver. Compared to analog transmission, digital com- 
munications operate with a lower signal-to-noise ratio (SNR) and can therefore 
provide almost error-free performance over long distances. In addition, digital 
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Fig. 2.9. A delta modulation 
(DM) system, (a) Approximation 
of the information-bearing 
signal x(t) with a staircase 
signal x(Ar 7" ), referred to as the 
DM signal, (b) Binary signal 
transmitted to the receiver. 


communications allow for other data processing features such as error cor- 
rection, data encryption, and jamming resistance, which can be exploited for 
secure data transmission. In this section, we study a basic waveform coding pro- 
cedure, referred to as delta modulation (DM), which is widely used to transform 
an analog signal into a digital signal. 

The process of DM is illustrated in Fig. 2.9, where an information-bearing 
analog signal x(t ) is approximated by a delta modulated signal x(t). The analog 
signal x(t) is uniformly sampled at time instants t — kT . At each sampling 
instant, the sampled value x(kT) of the analog signal is compared with the 
amplitude of the DM signal x(kT). If the magnitude of the sampled signal 
x(kT) is greater than the corresponding magnitude of the DM signal x(kT), 
then the DM signal is increased by a fixed amplitude, say A , at t — kT . Bit 1 is 
transmitted to the receiver to indicate the increase in the amplitude of the DM 
signal. On the other hand, if the amplitude of the sampled signal x(kT) is less 
than the magnitude of the DM signal x(kT), then the DM signal is decreased by 
A. Bit 0 is transmitted to the receiver to indicate the decrease in the amplitude 
of the DM signal. In other words, a single bit is used at each time instant t = kT 
to indicate an increase or decrease in the amplitude of the information-bearing 
signal. 

A major advantage of DM is the simple structure of the receiver. At the 
receiving end, the signal x(t) is reconstructed using the following simple 
relationship: 


x(kT) = x{(k - 1 )T) + b k A, (2.25) 

where bk = 1 if bit 1 is received and b/- = — I if bit 0 is received. Solving for 
x(kT), Eq. (2.25) is represented as follows: 

n 

x(kT) = b k & + *(0), (2.26) 

*= o 

where i(0) represents the initial value used at f = 0 in the DM signal. 
Equation (2.26) implies that the DM signal x(kT) is obtained by accumulating 
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the values of the bk A’s. Such a DT system that accumulates the values of the 
input is referred to as an accumulator. It may be noted that the receiver of a 
DM system is a linear system as it can be modeled by a constant-coefficient 
difference equation. 


2.1.8 Digital filter 

Digital images are made up of tiny “dots” obtained by sampling a two- 
dimensional (2D) analog image. Each dot is referred to as a picture element, or 
a pixel. A digital image, therefore, can be modeled with a 2D array, x\m,n\, 
where the index (m, n) refers to the spatial coordinate of a pixel with m being 
the number of the row and n being the number of the column. In a monochrome 
image, the value x [m , n ] of a pixel indicates its intensity value. When the pixels 
are placed close to each other and illuminated according to their intensity values 
on the computer monitor, a continuous image is perceived by the human eye. 

In digital image processing, spatial averaging is frequently used for smooth- 
ing noise, lowpass filtering, and subsampling of images. In spatial averaging, 
the intensity of each pixel is replaced by a weighted average of the intensities 
of the pixels in the neighborhood of the reference pixel. Using a unidirectional 
fourth-order neighborhood, the reference pixel x[m, n] is replaced by the spa- 
tially averaged value: 

1 

y[m, «] = -( x[m , n] + x[m, n — 1] + x[m — 1, n] + x [m — 1, n — 1]), 

(2.27) 

where y[m, n] represents the 2D output image of the spatial averaging system. 
Equation (2.27) is an example of a 2D finite-difference equation and it models 
a 2D DT system with input x[m, n] and output y[m, n]. 

In this section, we have considered some interesting applications of signal 
processing in CT and DT systems. Our goal has been to motivate the reader 
to learn about the techniques and basic concepts required to investigate one 
or more of these application areas. Each of the discussed areas is a subject 
of considerable study. Nevertheless, certain fundamentals are central to most 
applications, and many of these basic concepts will be discussed in the chapters 
that follow. 


2.2 Classification of systems 


In the analysis or design of a system, it is desirable to classify the system 
according to some generic properties that the system satisfies. In this segment 
we introduce a set of basic properties that may be used to categorize a system. 
For a system to possess a given property, the property must hold true for all 
possible input signals that can be applied to the system. If a property holds for 
some input signals but not for others, the system does not satisfy that property. 
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In this section, we classify systems into six basic categories: 

(i) linear and non-linear systems; 

(ii) time-invariant and time-varying systems; 

(iii) systems with and without memory; 

(iv) causal and non-causal systems; 

(v) invertible and non-invertible systems; 

(vi) stable and unstable systems. 

In the following discussion, we make use of the notation given in Eqs. (2.1) and 
(2.2), which we repeat here: 

CT system x(t) — » y(f); 

DT system x[k ] — »■ y\k\, 

to refer to output y(t ) resulting from input x(t) for a CT system and to output 
y[k\ resulting from input x[k] for a DT system. 


2.2.1 Linear and non-linear systems 

A CT system with the following set of inputs and outputs: 
x \ (0 -* yi(0 and x 2 (t) y 2 (t) 

is linear iff it satisfies the additive and the homogeneity properties described 
below: 

additive property x\ (t) + x 2 (t) -> )’\ (t) + y 2 (t)\ (2.28) 

homogeneity property axi(t) — > ay\(t)\ (2.29) 

for any arbitrary value of a and all possible combinations of inputs and out- 
puts. The additive and homogeneity properties are collectively referred to as 
the principle of superposition. Therefore, linear systems satisfy the principle 
of superposition. Based on the principle of superposition, the properties in 
Eqs. (2.28) and (2.29) can be combined into a single statement as follows. A 
CT system with the following sets of inputs and outputs: 

x \ (0 -* yi(0 and x 2 (t) -* y 2 (t ) 

is linear iff 


axi(t) + fix 2 (t) -> ay\(t) + fiy 2 (t) (2.30) 

for any arbitrary set of values for a and /l, and for all possible combinations of 
inputs and outputs. 

Likewise, a DT system with 

•DOT JiOT and x 2 [k]^y 2 [k], 
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is linear iff 


a xi [*] + Px 2 [k] -*• a yi [k] + Py 2 [k] (2.31) 

for any arbitrary set of values for a and p, and for all possible combinations of 
inputs and outputs. 

A consequence of the linearity property is the special case when the input x 
to a linear CT or DT system is zero. Substituting a = 0 in Eq. (2.29) yields 

0 • xi(f) = 0 — > 0 ■ y\(t) = 0. (2.32) 

In other words, if the input x(t) to a linear system is zero, then the output 
y(r) must also be zero for all time t . This property is referred to as the zero- 
input, zero-output property. Both CT and DT systems that are linear satisfy 
the zero-input, zero-output property for all time t. Note that Eq. (2.32) is a 
necessary condition and is not sufficient to prove linearity. Many non-linear 
systems satisfy this property as well. 


Example 2.1 

Consider the CT systems with the following input-output relationships: 


(a) differentiator 

II 

a. £ 

(2.33) 

(b) exponential amplifier 

x(t) e x(0 ; 

(2.34) 

(c) amplifier 

y{t) = 3 jc(0; 

(2.35) 

(d) amplifier with additive bias 

y(r) = 3x(r) + 5. 

(2.36) 


Determine whether the CT systems are linear. 


Solution 

(a) From Eq. (2.33), it follows that 


and 


which yields 


xi(t) 


x 2 {t) 


d*i(0 

dr 

d *2 (0 
dr 


= Ti(0 




d dxi(r) d.v 2 (r) 

0LX\ (r) + Pi X 2 (t) -* — {otXi(t) + ft\x 2 (t )} = a— b p . 

dr dr dr 


Since 


dvi(r) d x 2 (t) 


= oiydt) + Py 2 {t), 


dr dr 

the differentiator as represented by Eq. (2.33) is a linear system, 
(b) From Eq. (2.34), it follows that 

xi(t) e- Vl(r) = yi(t) 
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and 

*2(0 e l2(,) = y 2 (t), 


giving 

a*i(0 + iS*2(0-»- e“* lW+ ^ 2(0 . 

Since 

e a* lW +^« = e«‘W ■ e fe(,) = [yi(0]“ + [y 2 (0] /J # ajhCO + Pyi (0, 

the exponential amplifier represented by Eq. (2.34) is not a linear system, 
(c) From (2.35), it follows that 

*i(0 3xi(i) = yi(0 


*2(0 -> 3x 2 (0 = y 2 (0. 


giving 

a*i(0 + 0X2(0 -* 3{axi(0 + fix 2 (01 = 3ax\(0 + 3fix 2 (0 
= ayi(0 + 0y 2 (O- 

Therefore, the amplifier of Eq. (2.35) is a linear system. 

(d) From Eq. (2.36), we can write 

*i(0 -> 3*i (0 + 5 = yi(0 

and 

*2(0 -> 3x 2 (0 + 5 = y 2 (0, 


giving 


ax\(0 + 0x 2 (O -> 3[axi(0 + fix 2 (t)] + 5. 


Since 

3[a*i(0 + Px 2 (0] + 5 = ayi(0 + 0y 2 (O - 5, 

the amplifier with an additive bias as specified in Eq. (2.36) is not a linear 
system. 

An alternative approach to check if a system is non-linear is to apply the 
zero-input, zero-output property. For system (b), if x(t ) = 0, then y(t) = 1. 
System (b) does not satisfy the zero-input, zero-output property, hence system 
(b) is non-linear. Likewise, for system (d), if x(t ) = 0 then y(t) = 5. Therefore, 
system (d) is not a linear system. 

If a system does not satisfy the zero-input, zero-output property, we can safely 
classify the system as a non-linear system. On the other hand, if it satisfies 
the zero-input, zero-output property, it can be linear or non-linear. Satisfying 
the zero-input, zero-output property is not a sufficient condition to prove the 


76 


Part I Introduction to signals and systems 


Fig. 2.10. Incrementally linear 
system expressed as a linear 
system with an additive offset. 



linearity of a system. A CT system y(t ) = x 2 (t) is clearly a non-linear system, 
yet it satisfies the zero-input, zero-output property. For the system to be linear, 
it must satisfy Eq. (2.30). 

Incrementally linear system In Example 2.1, we proved that the amplifier 
y(t ) = 3 x(t) represents a linear system, while the amplifier with additive bias 
y(f) = 3 x(t) + 5 represents a non-linear system. System y(t) = 3 x(t) + 5 sat- 
isfies a different type of linearity. For two different inputs Xi (t) and *2(0, the 
respective outputs of system y(t) = 3 x(t) + 5 are given by 

input Xi(t) yi(f) = 3x\(t) + 5; 

input x 2 (t) yi(t) — 3 x 2 (t) + 5. 

Calculating the difference on both sides of the above equations yield 

yiif) ~ yi(t) = 3[x 2 (t) - xi (/)] 


or 

A y(t) = 3Ax(t). 

In other words, the change in the output of system y(t) = 3 x(t) + 5 is linearly 
related to the change in the input. Such systems are called incrementally linear 
systems. 

An incrementally linear system can be expressed as a combination of a linear 
system and an adder that adds an offset y z i(0 to the output of the linear sys- 
tem. The value of offset y z i(t) is the zero-input response of the original system. 
SystemSi, y(t) = 3 x(t) + 5, for example, can be expressed as a combination of 
a linear system S 2 , y(t) = 3 x(t), plus an offset given by the zero-input response 
of Si, which equals _y z ; (f) = 5. Figure 2. 10 illustrates the block diagram repre- 
sentation of an incrementally linear system in terms of a linear system and an 
additive offset y z i(t). 

Example 2.2 

Consider two DT systems with the following input-output relationships: 

(a) differencing system y[£] = 3(x[£] — x[k — 2]); (2.37) 

(b) sinusoidal system y[k~\ = sin(jc[£]). (2.38) 

Determine if the DT systems are linear. 
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Solution 

(a) From Eq. (2.37), it follows that: 

*i [A] -» 3*i [A] - 3*i [A - 2] = y x [k\ 

and 

x 2 [k]^3x 2 [k]-3x 2 [k-2] = y 2 [k], 

giving 

a*i[A ] + Px 2 [k] — >■ 3a*i[A] — 3a*i[A — 2] + 3/1*2 [A’] — 3/1*2 [A — 2], 
Since 

3a*, [A] - 3a*i [k - 2] + 3£* 2 [A] - 3 px 2 [k - 2] = ay x [k] + fiy 2 [k], 

the differencing system, Eq. (2.37), is linear. 

To illustrate the linearity property graphically, we consider two DT input sig- 
nals x\[k ] and x 2 [k] shown in the two top-left subplots in Figs. 2.1 1(a) and (c). 
The resulting outputs 31 [A] and y 2 [k] for the two inputs applied to the differ- 
encing system, Eq. (2.37), are shown in the two top-right stem subplots in 
Figs. 2.11(b) and (d), respectively. A linear combination, *3 [A] = *1 [k] + 
2*2 [A'], of the two inputs is shown in the bottom-left subplot in Fig. 2.11(e). 
The resulting output 3^3 [A'] of the system for input signal *3 [A] is shown in 
the bottom-right subplot in Fig. 2.11(f). By looking at the subplots, it is clear 
that the output 3^3 [A] = 31 [A] + 2y 2 [k], In other words, the output 33 [A] can be 
determined by using the same linear combination of outputs 31 [A'] and y 2 [k] as 
the linear combination used to obtain *3 [A] from *i[A] and *2[A], 

(b) From Eq. (2.38), it follows that: 

*1 [A] -* sin(*![A]) = y! [A], *2 [A] -> sin(* 2 [A]) = 32 [A], 

giving 

a*i[A] + /0* 2 [A] ->• sin(a*i[A]) + sin(/3* 2 [A]) ^ ay, [A] + Py 2 [k}\ 

therefore, the sinusoidal system in Eq. (2.38) is not linear. 

To illustrate graphically that system (b) indeed does not satisfy the linearity 
property, we consider two input signals *1 [A] and *2 [A] shown, respectively, in 
Figs. 2.12(a) and (c). Their corresponding outputs, 31 [A] and 32 [^] , are shown 
in Figs. 2.12(b) and (d). The output 33 [A] of the system for the input signal 
*3 [A] = *i[A] + 2*2 [A], obtained by combining *i[A] and *2 [A], is shown in 
Fig. 2.12(f). Comparing Fig. 2.12(f) with Figs. 2.12(b) and (d), we note that 
output 33 [A] ^ 3 i[A] + 232[A]. To check, we select A = 4. From Fig. 2.12, 
inputs *i[4] = 0 and *2[4] = 2. Using Eq. (2.38), outputs 31 [4] = sin(O) = 0 
and32[4] = sin(2) = 0.91. The linear combination 31 [A] + 232[A] of3i[A] and 

32 [A] at A = 4 gives a value of 1.82. If the system is linear, we should get 

33 [4] =1.82 from the combined input *3 [A] = *1 [A] + 2*2 [A] = 4 at A = 4. 
Substituting in Eq. (2.38), we obtain 33 [4] = sin(4) = —0.76. Since the value 
of output 33 [A] at A = 4 obtained from the linear combination of individual 
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Fig. 2.11. Input-output pairs of 
the linear DT system specified in 
Example 2.2(a). Parts (a)-(f) are 
discussed in the text. 


outputs y\ [k\ and j > 2 \k\ is different from the value obtained directly by applying 
the combined input, we may say that the system in Fig. 2.12(b) is not linear. 
The graphical result is in accordance with the mathematical proof. 


Example 2.3 

Consider the AM system with input-output relationship given by 

s(t) = [1 + 0.2 m(t)] cos(2;r x 10 8 f). (2.39) 

Determine if the AM system is linear. 
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Fig. 2.12. Input-output pairs of 
the linear DT system specified in 
Example 2.2(b). Parts (a)-(f) are 
discussed in the text. 


Solution 

From Eq. (2.39), it follows that: 

Mti(r) — > [1 + 0.2«7i(t)] cos(27r x 10 8 t) = si(t) 


and 

rri2(t) — > [1 + 0.2m2(0] cos(27T x 10 8 t) = S2(t), 


giving 

ani\{t) + — > [1 + 0.2{am\{t) + Pni 2 (t)}] cos(27T x 10 8 t) 

^ asi(t) + Ps 2 (t). 

Therefore, the AM system is not linear. 


2.2.2 Time-varying and time-invariant systems 

A system is said to be time-invariant (TI) if a time delay or time advance of the 
input signal leads to an identical time-shift in the output signal. In other words, 
except for a time-shift in the output, a TI system responds exactly the same 
way no matter when the input signal is applied. We now define a TI system 
formally. 
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A CT system with x(t) — >■ y(t ) is time-invariant iff 

x(t - t 0 ) -> y(t - t 0 ) (2.40) 

for any arbitrary time-shift tg. Likewise, a DT system with x[k ] -» y[k] is 
time-invariant iff 


x[k - k 0 \ ^ y[k - k 0 ] (2.41) 

for any arbitrary discrete shift kg. 

Example 2.4 

Consider two CT systems represented mathematically by the following input- 
output relationship: 

(i) system I y(t) = sin(.t(f)); (2.42) 

(ii) system II y(t) = t sin(.r(f)). (2.43) 

Determine if systems (i) and (ii) are time-invariant. 

Solution 

(i) From Eq. (2.42), it follows that: 

x(t) sin(x(f)) = y(t) 

and 

x(t - t 0 ) sin(x(f - t 0 )) = y(t - t 0 ). 

Since sin[.v(t — to)] = y(t — to), system I is time-invariant. We demonstrate 
the time-invariance property of system I graphically in Fig. 2.13, where a time- 
shifted version x(t — 1) of input x (f) produces an equal shift of one time unit 
in the original output y(t) obtained from x(t). 

(ii) From Eq. (2.43), it follows that: 

x{t) — > t sin(.r(t)) = y(t). 

If the time-shifted signal x{t — to) is applied at the input of Eq. (2.43), the new 
output is given by 

x(t -to)~*t sin(x(f - t 0 )). 

The shifted output y(t — to) is given by 

y(t - t 0 ) = (t - to) sin(x(f - t 0 )). 

Since t sin[x(f — to)] ^ y(t — to), system II is not time-invariant. The time- 
invariance property of system II is demonstrated in Fig. 2.14, where we 
observe that a right shift of one time unit in input x(t) alters the shape of the 
output y(t). 
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(a) 


(b) 



(c) 


(d) 


Fig. 2.13. Input-output pairs of Example 2.5 

the CT time-invariant system Consider two DT systems with the following input-output relationships: 


(i) system I 


y[k] = 3(xM - x[k - 2]); 
y[A] = kx[k]. 


specified in Example 2.4(i). 

(a) Arbitrary signal x(t). 

(b) Output of system for input (ii) system II 
signal x(t). (c) Signal x(t - I). 

(d) Output of system for input Determine if the systems are time-invariant. 

signal x(t - 1). Note that except 

for a time-shift, the two output 

signals are identical. Solution 

(i) From Eq. (2.44), it follows that: 

x[k] -* 3(x[/t] - x[k - 2]) = y[A-] 


(2.44) 

(2.45) 



(a) 


(b) 



(c) 


(d) 


Fig. 2.14. Input-output pairs of the time-varying system specified in Example 2.4(ii). (a) Arbitrary signal 
x(t). (b) Output of system for input signal x(t ). (c) Signal x(t - 1 ). (d) Output of system for input signal 
x(t - 1). Note that the output for time-shifted input x(t - 1) is different from the output y(t) for the 
original input x(t). 
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5 



(a) (b) 


7 



(c) (d) 


Fig. 2.15. Input-output pairs of 
the DT time-varying system 
specified in Example 2.5(ii). The 
output y 2 [k 1 for the time-shifted 
input x 2 [Ar] = x [k - 2] is 
different in shape from the 
output y[k] obtained for input 
x[/r]. Therefore the system is 
time-variant. Parts (a)-(d) are 
discussed in the text. 


and 


x[k — &o] — »■ 3 {x[k — fco] — x[k — ko — 2]) = y[£ — A'o]- 

Therefore, the system in Eq. (2.44) is a time-invariant system. 

(ii) From Eq. (2.45), it follows that: 

x[k] -* kx[k] = y[k] 


and 


x[k — ko] -> kx[k — fco] ^ y[k — ko] = (k — ko)x[k — /ro] - 

Therefore, system II is not time-invariant. In Fig. 2.15, we plot the outputs of 
the DT system in Eq. (2.45) for input x[k], shown in Fig. 2.15(a) and a shifted 
version x[k — 2] of the input, shown in Fig. 2.15(c). The resulting outputs are 
plotted, respectively, in Figs. 2.15(b) and (d). As expected, the Fig. 2.15(d) is 
not a delayed version of Fig. 2.15(b) since the system is time-variant. 
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r 2 r l 




Fig. 2.16. (a) Passive electrical circuit comprising resistors R i and /? 2 . (b) Active electrical circuit 
comprising resistor R, inductor L, and capacitor C. Both inductor L and capacitor C are storage 
components, and hence lead to a system with memory. 


2.2.3 Systems with and without memory 

A CT system is said to be without memory ( memoryless or instantaneous ) if its 
output y(t ) at time t = to depends only on the values of the applied input x(t) 
at the same time t = to. On the other hand, if the response of a system at t = to 
depends on the values of the input x(t ) in the past or in the future of time t = to, 
it is called a dynamic system, or a system with memory. Likewise, a DT system 
is said to be memory less if its output y[k ] at instant k — ly depends only on the 
value of its input x\k\ at the same instant k = ko . Otherwise, the DT system is 
said to have memory. 

Example 2.6 

Determine if the two electrical circuits shown in Figs. 2.16(a) and (b) are 
memoryless. 


Solution 

The relationship between the input voltage v(f) and the output voltage y(t) 
across resistor R i in the electrical circuit of Fig. 2.16(a) is given by 


y(t) = 


Ri 

Ri + Ri 


v(r). 


(2.46) 


For time t — to, the output y(to) depends only on the value v(fo) of the input v(r) 
at t = to- The electrical circuit shown in Fig. 2. 16(a) is, therefore, a memoryless 
system. 

The relationship between the input current i (t) and the output voltage y(t ) in 
Fig. 2.16(b) is given by 


y(t) = 


t 

— J i(r)dr. 

— OO 


(2.47) 
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Table 2.1. Examples of CT and DT systems with and without memory 


Continuous-time 

Discrete-time 

Memoryless systems 

Systems with memory 

Memoryless systems 

Systems with memory 

y(t) = 3jc(0 + 5 

y(t) = x(t - 5) 

y\k\ = 3 x\k] + 7 

y[k] = x[k- 5] 

y(t) = sin{.r(f)} + 5 

y(t) = x(t + 2) 

y[k] — sin(jc[A]) + 3 

y[l] = x\k + 3] 

y (?) = e Jt(<) 

y(t) = x(2 1) 

2 

Id 

II 

s 

y[k] = x[2 kj 

y(t) = x\t) 

y(t) = x(t/2) 

y[k\ = x 2 [k] 

ym = x[k/2\ 


To compute the output voltage y(to) at time to, we require the value of the current 
source for the time range (— 00 , to], which includes the entire past. Therefore, 
the electrical circuit in Fig. 2.16(b) is not a memoryless system. 

In Table 2. 1 , we consider several examples of memoryless and dynamic systems. 
The reader is encouraged to verify mathematically the classifications made in 
Table 2.1. 

As a side note to our discussion on memoryless systems, we consider another 
class of systems with memory that require only a limited set of values of input 
x(t) in to — T < t < to to compute the value of output y(t). Such CT systems, 
whose response _y(r) is completely determined from the values of input x(t) over 
the most recent past V time units, are referred to as finite-memory or Markov 
systems with memory of length T time units. Likewise, a DT system is called 
a finite-memory or a Markov system with memory of length M if output y[k\ 
at k — ko depends only on the values of input x[k] for ko — M < k < ko in the 
most recent past. 


2.2.4 Causal and non-causal systems 

A CT system is causal if the output at time to depends only on the input x(t ) for 
t < to . Likewise, a DT system is causal if the output at time instant ko depends 
only on the input x [£] for k < ko. A system that violates the causality condition is 
called a non-causal (or anticipative) system. Note that all memoryless systems 
are causal systems because the output at any time instant depends only on 
the input at that time instant. Systems with memory can either be causal or 
non-causal. 


Example 2.7 


(i) CT time-delay system 

(ii) CT time-forward system 

(iii) DT time-delay system 

(iv) DT time-advance system 

(v) DT linear system 


y(t) = x(t — 2) => causal system; 
y(t) = x(t + 2) =>■ non-causal system; 

_y [A] = x[k — 2] =>■ causal system; 
y[£] = x[k + 2] => non-causal system; 
y[k] = x[k — 2] + x[k + 10] =>• non-causal 
system. 
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Table 2.2. Examples of causal and non-causal systems 

The CT and DT systems are represented using their input-output relationships. Note that all systems in the table 
have memory. 


CT systems 

DT systems 

Causal 

Non-causal 

Causal 

Non-causal 

y(t) = x(t - 5) 

y(t ) = X(t + 2) 

y[k] = 3a [A - 1] + 7 

y[A] = a [A + 3] 

y(t) = sin{jf(t - 4)} + 3 

y(t) = sin(A'(f + 4)1 + 3 

y[k] = sin(A[A - 4]) + 3 

v[A] = sin(A[A + 4]) + 3 

y(t) — e i(, - 2) 

y(t) = x(2t) 

y[k] = e T[A '- 21 

y[A] = a[2A] 

CN 

1 

H 

II 

c^T 

H 

II 

y[A] = a 2 [A - 5] 

>’[A] = a [A/2] 

y(t) = X(t - 2) + x(t - 5) 

y{t) = x{t - 2) + x(t + 2) 

V [A] = a [A - 2] + a [A - 8] 

>’|A] = a [A + 2] + a [A - 8] 


x(t) 


CT 

y(t) 

inverse 



DT 

y\k] 

inverse 

system 


system 



system 


system 


(a) 


(b) 


Fig. 2.17. Invertible systems. 

(a) Inverse of a CT system. 

(b) Inverse of a DT system. 


Causality is a required condition for the system to be physically realizable. A 
non-causal system is a predictive system and cannot be implemented physically. 
Table 2.2 presents examples of causal and non-causal systems in CT and DT 
domains. 


2.2.5 Invertible and non-invertible systems 

A CT system is invertible if the input signal x(t) can be uniquely determined 
from the output y(t) produced in response to x(t ) for all time t e (— oo, oo). 
Similarly, a DT system is called invertible if, given an arbitrary output response 
y[k\ of the system for A' e (— oo, oo), the corresponding input signal * [A] can be 
uniquely determined for all time A e (— oo, oo). To be invertible, two different 
inputs cannot produce the same output since, in such cases, the input signal 
cannot be uniquely determined from the output signal. 

A direct consequence of the invertibility property is the determination of a 
second system that restores the original input. A system is said to be invertible 
if the input to the system can be recovered by applying the output of the original 
system as input to a second system. The second system is called the inverse 
of the original system. The relationship between the original system and its 
inverse is shown in Fig. 2.17. 

Example 2.8 

Determine if the following CT systems are invertible. 

(i) Incrementally linear system: 


y(t) — 3x(t) + 5. 
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The input-output relationship is expressed as follows: 

x(t)= ^ty(0 — 5]. 

The above expression shows that input x(t ) can be uniquely determined from 
the output signal y(t). Therefore, the system is invertible. 

(ii) Cosine system: 

y(t) = cos[x(0]. 

The input-output relationship is expressed as follows: 
x(t) — cos _1 [y(?) — 5] + 2icm, 

where m is an integer with values m = 0, ±1, ±2, . . . The above relationship 
shows that there are several possible values of x(t) for a given value of y(t). 
Therefore, system (ii) is a non-invertible system. 

(iii) Squarer: 

y(0 = MO] 2 - 

The input-output relationship is expressed as follows: 

x(t) = ±/y(tj. 

In other words, for a given y(t) value, there are two possible values of x(t). 
Because x(t) is not unique, the system is non-invertible. 

(iv) Time-differencing system: 

y(t ) = x(t) — x(t — 2). 

The input-output relationship is expressed as follows: 

x(t) — y(t) + x(t - 2). 

Since x(t — 2) = y(t — 2) + x(t — 4), the earlier equation can be expressed as 
follows: 

x(t) = y(t) + y(t - 2) + x(t - 4). 

By recursively substituting first the value of x(t — 4) and later for other delayed 
versions of x(t), the above relationship can be expressed as follows: 

OO 

x(t) = Y^y(t ~ 2m). 

m = 0 

Using the above relationship, the input signal x(t ) can be uniquely reconstructed 
if y(t) is known. Therefore, the system is invertible. 

(v) Integrating system I: 

t 

y (0 = J x(r)dr. 
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Differentiating both sides of the above equation yields 

dv 

The above relationship shows that for a given output signal, the corresponding 
input signal can be uniquely determined. Therefore, the system is invertible, 
(vi) Integrating system II: 

t 

y (t ) = J x(r)dT. 


t—2 


We can represent y(t) as follows: 


t—2 


y (t) = J x(r)dr - J 


x(r)dT. 


Differentiating both sides, we obtain 

dv 

— = x (t) - x(t - 2). 
dt 

Following the procedure used in part (iv) and expressing the result in terms of 
the input signal x(t), we obtain 

dy(r — 2m) 




m = 0 


dr 


The above relationship shows that for a given output signal, the corresponding 
input signal can be uniquely determined. Therefore, the system is invertible. 


Example 2.9 

Determine if the following DT systems are invertible. 

(i) Incrementally linear system: 

y [k] = 2 x[k] + 7. 

The input-output relationship is expressed as follows: 

x[k] = \{ y [k]-l}. 

The above expression shows that given an output signal, the input can be 
uniquely determined. Therefore, the system is invertible. 

(ii) Exponential output: 

v|A I = e' 1 * 1 . 

The input-output relationship is expressed as follows: 

x[k] = ln{y[A-]}. 

The above expression shows that given an output signal, the input can be 
uniquely determined. Therefore, the system is invertible. 
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(iii) Increasing ramped output: 

y[k] = kx[k]. 

The input-output relationship is expressed as follows: 

x[k] = l - y[k ]. 

The input signal can be uniquely determined for all time instant k, except at 
k = 0. Therefore, the system is not invertible. 

(iv) Summer: 

y[k] = x[k] + x[k - 1]. 

Following the procedure used in Example 2.8(iv), the input signal is expressed 
as an infinite sum of the output y[k] as follows: 

x[k] = y[k] - y[k - 1] + y[k - 2] - y[A - 3] + - • • • 

oo 

m= 0 

The input signal x[k] can be reconstructed if y[m] is known for all m < k. 
Therefore, the system is invertible. 

(v) Accumulator: 

k 

y[k] = x ^' 

m= — oo 

We express the accumulator as follows: 

k - 1 

y[k] = x[k]+ x[m]=x[k] + y[k- 1] 

m=— oo 

or 

X[k] = y[k] - y[k - 1], 

Therefore, the system is invertible. 

2.2.6 Stable and unstable systems 

Before defining the stability criteria for a system, we define the bounded prop- 
erty for a signal. A CT signal x(t) or a DT signal x[k] is said to be bounded in 
magnitude if 

CT signal \x{t)\ < B x < oo for t e (— oo, oo); (2.48) 

DT signal |*[£]| < B x < oo for A' e (— oo, oo), (2.49) 

where B x is a finite number. Next, we define the stability criteria for CT and 
DT systems. 

A system is referred to as bounded-input, bounded-output (BIBO) stable if 
an arbitrary bounded-input signal always produces a bounded-output signal. In 
other words, if an input signal x(t) for CT systems, or x[k] for DT systems, 
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x(t) 

▲ 

1 - 



(b) 


Fig. 2.18. Input and output of 
the unstable system in Example 
2.10(ii). (a) Input x(t) to the 
system, (b) Output y(t) of the 
system. The input x(r) is 
bounded for all t, but the output 
y(t) is unbounded as f oo. 


satisfying either Eq. (2.48) or Eq. (2.49), is applied to a stable CT or DT system, 
it is always possible to find an finite number B y < oo such that 

CT system |y(f)| < B v < oo for t e (— oo, oo); (2.50) 

DT system | v [/c] | < B y < oo for A' e (— oo, oo). (2.51) 


Example 2.10 

Determine if the following CT systems are stable, 
(i) Incrementally linear system: 


y(t) = 50x(t) + 10. (2.52) 

Assume \x{t)\ < B x for all t. Based on Eq. (2.52), it follows that: 


y(t) < 50/f v + 10 = By for all t. 


As the magnitude of y(t) does not exceed 50 B x + 10, which is a finite number, 
the incrementally linear system given in Eq. (2.52) is a stable system. 

(ii) Integrator: 

t 

y(t) = J x(r)dr. (2.53) 

— OO 


This system integrates the input signal from t = — oo to t. Assume that a unit- 
step function x(t ) = u(t ) is applied at the input of the integrator. The output of 
the system is given by 


y(t) = tu{t) = 


0 

t 


t < 0 
t > 0. 


Signal y(t) is plotted in Fig. 2.18(b). It is observed that y(t ) increases steadily 
for t > 0 and that there is no upper bound of y(t). Hence, the integrator is not 
a BIBO stable system. 


Example 2.11 

Determine if the following DT systems are stable. 

(i) y[k] = 50 sin(x[A]) + 10. (2.54) 

Note that sin(x[A]) is bounded between [—1, 1] for any arbitrary choice of a [/c]. 
The output y[k] is therefore bounded within the interval [—40, 60]. Therefore, 
system (i) is stable. 

(ii) y[k] = e lk \ (2.55) 

Assume |x[A]| < B x for all t. Based on Eq. (2.52), it follows that: 

y[A] < e Bx = B v for all A. 
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Therefore, system (ii) is stable. 


2 


(iii) 


v[A] = x[k~m]. 


(2.56) 


m =—2 


The output is expressed as follows: 

y[k] = x[k - 2] + x[k - 1] + x[k] + x[k + 1] + x[k + 2]. 

If \x[k]\ < B x for all k, then |y[A]| < 5 B x for all k. Therefore, the system is 
stable. 


The output is calculated by summing an infinite number of input signal values. 
Hence, there is no guarantee that the output will be bounded even if all the input 
values are bounded. System (iv) is, therefore, not a stable system. 


In signal processing, complex structures are formed by interconnecting simple 
linear and time-invariant systems. In this section, we describe three widely used 
configurations for developing complex systems. 


As shown in Fig. 2.19(a), a series or cascaded configuration between two sys- 
tems is formed by interconnecting the output of the first system 5) to the input 
of the second system S 2 . If the interconnected systems 5) and S 2 are linear, it 
is straightforward to show that the overall cascaded system is also linear. Like- 
wise, if the two systems 5) and S 2 are time-invariant, then the overall cascaded 
system is also time-invariant. Another feature of the cascaded configuration 
is that the order of the two systems Si and S 2 may be interchanged without 
changing the output response of the overall system. 

Example 2.12 

Determine the relationship between the overall output and input signals if 
the two cascaded systems in Fig. 2.19(a) are specified by the following 
relationships: 


k 


(iv) 



(2.57) 


2.3 Interconnection of systems 


2.3.1 Cascaded configuration 



S 2 : — + 3 y{t) = w(t ) with y(0) = 0; 
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x(t) 


(a) 


x{t) 




(b) 


(c) 


Fig. 2.19. Interconnection of 
systems: (a) cascaded 
configuration; (b) parallel 
configuration; (c) feedback 
configuration. Although these 
diagrams are for CT systems, the 
DT systems can be 
interconnected to form the three 
configurations in exactly the 
same manner. 


(ii) Si : w[k] - w[k - 1] = x[k] with w [0] = 0 
and 

S 2 : y[£] - 2 y[k - 1] = w[k] with y[0] = 0. 


Solution 

(i) Differentiating both sides of the differential equation modeling system S 2 
with respect to t yields 

d 2 y dy dw 

52: d^ + 3 ¥= dT 

Multiplying the differential equation modeling system S 2 by 2 and adding the 
result to the above equation yields 


d 2 y dy dw 

-f + 5— +6y(r)= — + 2w(r). 

dr 2 dr dr 


X(I) 


Based on the differential equation modeling system Si, the right-hand side of 
the equation equals x(t). The overall relationship of the cascaded system is, 
therefore, given by 

d 2 y dy 

~rj + 5— + 6y(f) = x(t). 

d t z dr 

(ii) Substituting k — p — 1 in the difference equation modeling system S 2 
yields 


S 2 : y[p — 1] — 2y[p — 2] = w[p — 1], 


or, in terms of time index k. 


S 2 : y[k — 1] — 2y[k — 2] = w[k — 1], 

Subtracting the above equation from the original difference equation modeling 
system S 2 yields 


S 2 : y[k] - 3 y[k - 1] + 2y[k - 2] = w[k] - w[k - 1] . 
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Based on the difference equation modeling system S\, the right-hand side of 
the above equation equals x\k}. The overall relationship of the cascaded system 
is, therefore, given by 

y[k]-3y[k-l] + 2y[k-2]=x[k]. 


2.3.2 Parallel configuration 

The parallel configuration is shown in Fig. 2.19(b), where a single input is 
applied simultaneously to two systems 5) and S 2 . The overall output response 
is obtained by adding the outputs of the individual systems. In other words, if 

Si : x(t) -> yi(r)andS 2 : x (t) -* y 2 (t), then S para iiei : x(t) yi(t) + y 2 (t). 

As for the series configuration, the system formed by a parallel combination 
of two linear systems is also linear. Similarly, if the two systems Si and S 2 are 
time-invariant, then the overall parallel system is also time-invariant. 

Example 2.13 

Determine the relationship between the overall output and input signals if the 
two parallel systems in Fig. 2. 19(b) are specified by the following relationships: 

dx d.v d 2 x 

(t) Si : yi (f) = x(t) + — and S 2 : y 2 (t) = x(t) + 3— +5— j ; 

dr dr at 1 

(ii) Si:yi[k]=x[k] - x[k - 1] and S 2 : y 2 [k]=x[k] - 2 x[k - 1] - x[k - 2], 

Solution 

(i) The response of the overall system is obtained by adding the two differential 
equations modeling the individual systems. The resulting expression is given 
by 

d x d 2 x 

Ti(0 + yi(t) = 2 x{t) + 4— + 5— y. 

dr dr^ 

Since y(t) — yi(r) + y 2 (t), the response of the overall system is given by 

dx d 2 x 

y(r) = 2x(r) + 4— + 5 — . 

dr d t l 

(ii) The response of the overall system is obtained by adding the two dif- 
ference equations modeling the individual systems. The resulting expression is 
given by 


ydk] + y 2 [k] = 2 x[k] - 3 x[k - 1] - x[k - 2], 
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Since y[£] = yi[£] + yi[k~\, the response of the overall system is given by 
y[k] = 2x[k] - 3x[k - 1] - x[k - 2\. 


2.3.3 Feedback configuration 

The feedback configuration is shown in Fig. 2. 19(c), where the output of system 
Si is fed back, processed by system S 2 , and then subtracted from the input signal. 
Such systems are difficult to analyze in the time domain and will be considered 
in Chapter 6 after the introduction of the Laplace transform. 


2.4 Summary 


In this chapter we presented an overview of CT and DT systems, classifying 
the systems into several categories. A CT system is defined as a transformation 
that operates on a CT input signal to produce a CT output signal. In contrast, a 
DT system transforms a DT input signal into a DT output signal. In Section 2.1, 
we presented several examples of systems used to abstract everyday physical 
processes. Section 2.2 classified the systems into different categories: linear 
versus non-linear systems; time-invariant versus variant systems; memory less 
versus dynamic systems; causal versus non-causal systems; invertible versus 
non-invertible systems; and stable versus unstable systems. We classified the 
systems based on the following definitions. 

( 1) A system is linear if it satisfies the principle of superposition. 

(2) A system is time-invariant if a time-shift in the input signal leads to 
an identical shift in the output signal without affecting the shape of the 
output. 

(3) A system is memoryless if its output at t = to depends only on the value 
of input at t = to and no other value of the input signal. 

(4) A system is causal if its output at t = to depends on the values of the input 
signal in the past, t < to, and does not require any future value (r > to) of 
the input signal. 

(5) A system is invertible if its input can be completely determined by observing 
its output. 

(6) A system is BIBO stable if all bounded inputs lead to bounded outputs. 

An important subset of systems is described by those that are both linear and 
time-invariant (LTI). By invoking the linearity and time-invariance properties, 
such systems can be analyzed mathematically with relative ease compared with 
non-linear systems. In Chapters 3-8, we will focus on linear time-invariant CT 
(LTIC) systems and study the time-domain and frequency-domain techniques 
used to analyze such systems. DT systems and the techniques used to analyze 
them will be presented in Part III, i.e. Chapters 9-17. 


94 


Part I Introduction to signals and systems 


node 1 




Fig. P2.1. RC circuit consisting of 
two resistors (R i and R 2 ) and a 
capacitor C . 

Fig. P2.3. AM demodulator. The 
input signal is represented by 
V] (f) = A c cos(2jrf c f) + m(t), 
where A c cos(2jrT c f) is the 
carrier and m(t) is the 
modulating signal. 


Fig. P2.2. Resonator in an AM modulator. 



Problems 


2.1 The electrical circuit shown in Fig. P2.1 consists of two resistors R i and 
/?2 and a capacitor C . 

(i) Determine the differential equation relating the input voltage V[ n (r) to 
the output voltage V out (f). 

(ii) Determine whether the system is (a) linear, (b) time-invariant; 
(c) memoryless; (d) causal, (e) invertible, and (f) stable. 

2.2 The resonant circuit shown in Fig. P2.2 is generally used as a resonator in 
an amplitude modulation (AM) system. 

(i) Determine the relationship between the input i(t) and the output v(t) 
of the AM modulator. 

(ii) Determine whether the system is (a) linear, (b) time-invariant; 
(c) memoryless; (d) causal, (e) invertible, and (f) stable. 

2.3 Figure P2.3 shows the schematic of a square-law demodulator used in the 
demodulation of an AM signal. Demodulation is the process of extract- 
ing the information-bearing signal from the modulated signal. The input- 
output relationship of the non-linear device is approximated by (assuming 
v i (f ) is small) 

v 2 (f) = c 1 v 1 (t) + c 2 v i 2 (f), 

where c \ and c 2 are constants, and vi(?) and v 2 (f) are, respectively, the 
input and output signals. 

(i) Show that the demodulator is a non-linear device. 

(ii) Determine whether the non-linear device is (a) time-invariant, 
(b) memoryless, (c) invertible, and (d) stable. 
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2.4 The amplitude modulation (AM) system covered in Section 2. 1 .3 is widely 
used in communications as in the AM band on radio tuner sets. Assume that 
the sinusoidal tone m(t ) = 2 sin(2jr x lOOf) is modulated by the carrier 
c{t) = 5cos(27r x 10 6 r). 

(i) Determine the value of the modulation index k that will ensure (1 + 
km(t)) > 0 for all t. 

(ii) Derive the expression for the AM signal s(t) and express it in the form 
of Eq. (2.10). 

(iii) Using the following trigonometric relationship: 

2 sin Q\ cos 0 2 = sin(0! + 0 2 ) + sin(6?j — 0 2 ), 

show that the frequency of the sinusoidal tone is shifted to a higher 
frequency range in the frequency domain. 


2.5 Equation (2.16) describes a linear, second-order, constant-coefficient dif- 
ferential equation used to model a mechanical spring damper system. 

(i) By expressing Eq. (2.16) in the following form: 


d 2 y 

dr 2 


con dy 

Q At 


+ ®n.y(0 


1 

M 


x(t). 


determine the values of &> n and Q in terms of mass M, damping factor 
r, and the spring constant k. 

(ii) The variable w n denotes the natural frequency of the spring damper 
system. Show that the natural frequency a> a can be increased by 
increasing the value of the spring constant k or by decreasing the 
mass M. 

(iii) Determine whether the system is (a) linear, (b) time-invariant, 
(c) memoryless, (d) causal, (e) invertible, and (f) stable. 


2.6 The solution to the following linear, second-order, constant-coefficient dif- 
ferential equation: 

d 2 y dv 

^+5- + 6y( f ) = .v(r) = 0, 

with input signal x(t) = 0 and initial conditions y(0) = 3 and y(0) = —7, 
is given by 


y(t) = [e -3f + 2e- 2 '] M (f). 


(i) By using the backward finite-difference scheme 


dy 


dr 


r=kAt 


y(kAt) - y((k - l)Ar) 
At 


d 2 y _ y(kAt) - 2y((k - l)Ar) + y((k - 2)Ar) 

,=kA, * (AO 2 


and 
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show that the finite-difference representation of the differential equa- 
tion is given by 

(1 + 5 At + 6(At) 2 )y[k] + (-2 - 5At)y[k - 1] + y[k - 2] = 0. 


(ii) Show that the ancillary conditions for the finite-difference scheme 
are given by 

y[0] = 3 and y[-l] = 3 + 7Af. 

(iii) By iteratively computing the finite-difference scheme for At = 
0.02 s, show that the computed result from the finite-difference equa- 
tion is the same as the result of the differential equation. 

2.7 Assume that the delta modulation scheme, presented in Section 2.1.7, 
uses the following design parameters: 
sampling period T — 0. 1 s and quantile interval A = 0. 1 V. 

Sketch the output of the receiver for the following binary signal: 
11111011111100000000 . 

Assume that the initial value x(0) of the transmitted signal x(t) at t = 0 
is x(0) = 0 V. 


2.8 Determine if the digital filter specified in Eq. (2.27) is an invertible system. 
If yes, derive the difference equation modeling the inverse system. If no, 
explain why. 


2.9 The following CT systems are described using their input-output relation- 
ships between input x(t) and output y(t). Determine if the CT systems are 
(a) linear, (b) time-invariant, (c) stable, and (d) causal. For the non-linear 
systems, determine if they are incrementally linear systems. 

(i) y(t) = x(t - 2); 

(ii) y(t) = x(2t - 5); 

(iii) y(t) = x(2 1) - 5; 

(iv) y(t ) = tx(t + 10); 

2 x(t) > 0 


(v) y(t) = 


(vi) y(t) = 


0 x(t) < 0; 

0 

x(t) — x(t — 5) 
(vii) y(f) = lx\t) + 5 x(t) + 3; 
(viii) y(t) = sgn(x(t)); 


t < 0 
t > 0; 


-/ 


(ix) y{t) = / j:(k)dl + 2 x(t)\ 


—to 


‘U 

-f 


(x) y{t) = I x(X)dA + 


d 4 y d 3 y d 2 y dy d 2 x 

(xi) -4 + 3-4 + 5-4 + 3— + y(t) =- rT + 2x(t) + 1. 
d t 4 dr 3 dr 2 dr ' dr 2 
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Fig. P2.ll. CT output y(f) for 
Problem 2.11. 


2.10 The following DT systems are described using their input-output relation- 
ships between input x [A'] and output y [A], Determine if the DT systems are 
(a) linear, (b) time-invariant, (c) stable, and (d) causal. For the non-linear 
systems, determine if they are incrementally linear systems. 

(i) y[k] = ax[k] + b; 

(ii) y[k] = 5x[3k - 2]; 

(iii) y[k] = 2 xM ; 

k 

(iv) y[A] = ^2 x[m]\ 


k+2 

(v) y[A] = J2 x[m]-2\x[k]\- 

m—k—2 

(Vi) y[k] + 5y[A - 1] + 9 y[k - 2] + 5 y[k - 3] + y[k - 4] 
= 2 x[k] + Ax[k - 1 ] + 2 x\k - 2], 

(vii) y[A] = 0.5v[6A - 2] + 0.5 a [6A + 2]. 


y[k] 

▲ 

4 



-2 


>k 


Fig. P2.12. DT output y[k] for 
Problem 2.12. 


2.11 For an LTIC system, an input x(t) produces an output y(t) as shown in 
Fig. P2.1 1. Sketch the outputs for the following set of inputs: 

(i) 5x(t ); (iii) x(t + 1) — x(t — 1); 

(ii) 0.5 x(t - 1) + 0.5x(f + 1); (iv) + 3x{t) 

d t 

2.12 For a DT linear, time-invariant system, an input x[k] produces an output 
y[A] as shown in Fig. P2.12. Sketch the outputs for the following set of 
inputs: 

(i) Ax [k - 1]; (iii) x[k + 1] - 2 x[k) + x[k - 1]; 

(ii) 0.5 jc[A - 2] + 0.5.t[A + 2]; (iv) x[-k]. 

2.13 Determine if the following CT systems are invertible. If yes, find the 
inverse systems. 

(i) y(t) = 3 x(t + 2); (iv) + y(t) = x (r); 

t at 

(ii) y(t) = J x(r - 10)dr; (v) y(t) = cos(27rx(t)). 

— OO 

(iii) y(t) = |x(t)|; 


2.14 Determine if the following DT systems are invertible. If yes, find the 
inverse systems. 

(i) y[k] = (k+l)x[k + 2]- 
\k\ 


(ii) y[£] = Y^x[m + 2]; 


> 7=0 


(iii) y[k] = x[k] S[k-2m]; 


(iv) y[k] = x[k + 2] + 2 x[k + 1] - 6 x[k] + 2 x[k - 1] + x[k - 2]; 

(v) y[k] + 2 y[k - 1] + y[k - 2] = x[k]. 


2.15 For an LTIC system, if x(t) — > y(t), show that 


d x{t) d y(t) 


d t 

that both x(t) and y(r) are differentiable functions. 


dr 


. Assume 
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Fig. P2.16. (a) Input-output 
pair for an LTI CT system. 

(b) Periodic input to the LTI 
system. 




1 1 



-2 

Fig. P2.18. Output ft [ft] for 
input x[k] = ,5[ft] in Problem 
2 . 18 . 


x«) 

1 


- 0.5 0.5 


>t 


At) 


->r 


(a) 


Xp (t) 




k 








- 2.5 - 1.5 - 0.5 0.5 1.5 2.5 




(b) 


2.16 Figure P2. 16(a) shows an input-output pair of an LTI CT system. Calcu- 
late the output y p (r) of the system for the periodic signal x v (t) shown in 
Fig. P2. 16(b). 

2.17 The output h{t) of a CT LTI system in response to a unit impulse function 
8(t) is referred to as the impulse response of the system. Calculate the 
impulse response of the CT LTI systems defined by the following input- 
output relationships: 

(i) y(t) = x(t + 2) - 2x(t ) + 2 x(t - 2); 

(ii) y(t) = J x(x -4) dr; 

t-t 0 

t 

(iii) y{t) = J e _2( ' _r) x(r — 4) dr; 

— OO 
oo 

,iv) ,(,) = / fCT - - Udr where /< 0 is a known signal and 

— OO 

T is a constant. 

2.18 The output h [k] of a DT LTI system in response to a unit impulse function 
<5 [/c] is shown in Fig. P2.18. Find the output for the following set of inputs: 

(i) x[k] = <5[£ + 1] + 8 [k] + <5 [it - 1]; 

OO 

(ii) x[k] = 8[k-4m ]; 

m = — oo 

(iii) x[k ] = u[k ]. 

2.19 A DT LTI system is described by the following difference equation: 

y[k] = x[k] - 2 x[k - 1] + x[k - 2], 

Determine the output y[A'] of the system if the input x[k] is given by 
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(a) 



Fig. P2.21. (a) Series 
configuration; (b) parallel 
configuration. 


(i) x[k] = 8[ky, 

(ii) x[k] = s[k-i] + s[k + iy 
\\k\ \k\<3 
0 elsewhere. 


(iii) x[k] = 


2.20 A five-point running average DT system is defined by the following input- 
output relationship: 

1 4 

y[k] = ~Y^x[k - m]. 

3 m=0 

(i) Show that the five-point running average DT system is an LTI system. 

(ii) Calculate the impulse response h [A] of the system when input x [A] = 

S[kl 

(iii) Compute the output y [A ] of the system for — 10 < A < 10 if the input 
x[A] = u[k], where u[k) is a unit step function. 

(iv) Based on your answer to (iii), calculate the impulse response h[k] 
of the system using the property S[k] = u[k] - u[k — 1], Compare 
your answer to h[k] obtained in (ii). 


2.21 The series and parallel configurations of systems Si and S 2 are shown in 
Fig. P2.21. The two systems are specified by the following input-output 
relationships: 


51 : y[k] = x[k] - 2 x[k - 1] + x[k - 2]; 

5 2 : y[k] = x[k] + x[k - 1] - 2 x[k - 2], 


(i) Show that .S) and S 2 are LTI systems. 

(ii) Calculate the input-output relationship for the series configuration 
of systems S) and S 2 as shown in Fig. P2.21(a). 

(iii) Calculate the input-output relationship for the parallel configuration 
of systems Si and S 2 as shown in Fig. P2.21(b). 

(iv) Show that the series and parallel configurations of systems Sj and 
S 2 are LTI systems. 



PART II 


Continuous-time signals 
and systems 





CHAPTER 



Time-domain analysis of 
LTIC systems 


In Chapter 2, we introduced CT systems and discussed a number of basic prop- 
erties used to classify such systems. An important subset of CT systems satisbes 
both the linearity and time-invariance properties. Such CT systems are referred 
to as linear, time-invariant, continuous-time (LTIC) systems. In this chapter, 
we will develop techniques for analyzing LTIC systems. Given an input-output 
representation for the system under consideration, we are primarily interested 
in calculating the output y(t) of the LTIC system from the applied input x(t). 
The output y{t) of an LTIC system can be evaluated analytically in the time 
domain in several ways. In Section 3.1, we use a linear constant-coefficient 
differential equation to model an LTIC system. In such cases, the output y(t) is 
obtained by directly solving the differential equation. In Sections 3.2 and 3.3, we 
define the unit impulse response h(t) as the output of an LTIC system to an unit 
impulse function S(t ) applied at the input. This development leads to a second 
approach for calculating the output y(t) based on convolving the applied input 
x{t) with the impulse response hit). The resulting integral is referred to as the 
convolution integral and is discussed in Sections 3.4 and 3.5. The properties of 
the convolution integral are covered in Section 3.6. The impulse response h(t) 
provides a complete description for an LTIC system. In Sections 3.7 and 3.8, 
we express the properties of an LTIC system in terms of its impulse response. 
The chapter is concluded in Section 3.9. 


For a linear CT system, the relationship between the applied input x(t ) and 
output y(t ) can be described using a linear differential equation of the following 
form: 


3.1 Representation of LTIC systems 



— + b 0 x(t), 


(3.1) 
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Fig. 3.1. Series RLC circuit used 
in Example 3.1. 



where coefficients a k , for 0 < k < («— I ), and b i: , forO < k < m, are parameters 
characterized by the linear system. If the linear system is also time-invariant, 
then the a \ and b k coefficients are constants. We will use the compact notation 
y to denote the first derivative of y{t) with respect to t . Thus y = dy/dt, y = 
d 2 y/df 2 , and so on for the higher derivatives. We now consider an electrical 
circuit that is modeled by a differential equation. 


Example 3.1 

Determine the input-output representations of the series RLC circuit shown in 
Fig. 3.1 for the three outputs v(f), w(t), and y(t). 


Solution 

Figure 3.1 illustrates an electrical circuit consisting of three passive compo- 
nents: resistor R, inductor L, and capacitor C . Applying Kirchhoff’s voltage 
law, the relationship between the input voltage x(t) and the loop current i(t) is 
given by 

x(t) = + Ri{t) + ^ J i(t)dt. (3.2) 

— OO 


Differentiating Eq. (3.2) with respect to t yields 




1 

C 


i(t) = 


dx 

dt' 


(3.3) 


We consider three different outputs of the RLC circuit in the following dis- 
cussion, and for each output we derive the differential equation modeling the 
input-output relationship of the LTIC system. 


Relationship between x(t) and v(t) The output voltage v(t) is measured across 
inductor L . Expressed in terms of the loop current i (t), the voltage v(f) is given 
by 
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Integrating the above equation with respect to t yields 


m = - / v(odf. 


By substituting the value of i(t) into Eq. (3.3), we obtain 


dv R 
— + Y y(t)+ 


-il 

hi 


dx 

v(t)dt = 

dr 


The above input-output relationship includes both differentiation and integra- 
tion operations. The integral operator can be eliminated by calculating the 
derivative of both sides of the equation with respect to t. This results in the 
following equation: 


d 2 v R dv 1 d 2 x 

dr 2 + L dr + LC ' (0 ~ dr 2 ’ 


(3.4) 


which models the input-output relationship between the input voltage x(t) and 
the output voltage v(r) measured across inductor L. Equation (3.4) is a linear, 
second-order differential equation with constant coefficients. In fact, it can 
be shown that an LTIC system can always be modeled by a linear, constant- 
coefficient differential equation with the appropriate initial conditions. 


Relationship between x(t) and iv(r) The output voltage w(r), measured across 
capacitor C, is given by 

t 

w(t)= — J i(t)dt, 

— OO 


which is expressed as follows: 


dw 

,(r) = C-. 


Substituting the value of i(t) into Eq. (3.3) yields 


LC 


_ d 3 w 
dr 2 ” 


d 2 w dvr cLr 
RC — — + — = — , 
dr 2 dr dr 


(3.5) 


which specifies the relationship between the input voltage x(t) and the output 
voltage w(r) measured across capacitor C. Equation (3.5) can be further sim- 
plified by integrating both sides with respect to r. The resulting equation is 
simplified to 

d 2 w dvr 

LC— T + RC— + w(t) = x(t), (3.6) 

dt l dr 


which is a linear, second-order, constant-coefficient differential equation. 


Relationship between x(t) and y(t) Finally, we measure the output voltage 
y(t ) across resistor R. Using Ohm’s law, the output voltage y(t) is given by 
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y(t) — i(t)R. Substituting the value of i(t) — y(t)/R into Eq. (3.3) yields 


L d 2 y dy 1 dx 

R~dt^ + dt + ~RC y{t) ~ dt’ 


(3.7) 


which is a linear, second-order, constant-coefficient, differential equation mod- 
eling the relationship between the input voltage x(t ) and the output voltage y(t) 
measured across resistor R. 


A more compact representation for Eq. (3.1) is obtained by denoting the differ- 
entiation operator d/d t by D: 

D "y + a n -iD"~ 1 y H f aj)y + a 0 y(t) 

= b m D m y + b m -iD m ~ 1 y + ■ ■ ■ + b,Dy + b 0 x(t). 


By treating D as a differential operator, we obtain 

(D” + a n - iD" 1 + • • • + fliD + ao) y(t) 

Q(D) 

= ( b m D m + +---+b 1 D + bp) x(t), (3.8) 

P(D) 


or 


Q(D)y(f) = P(Q)a(0, (3.9) 

where Q(D) is the /jth-order differential operator, P(D) is the /util-order differen- 
tial operator, and the a, and h, are constants. Equation (3.9) is used extensively 
to describe an LTIC system. 

To compute the output of an LTIC system for a given input, we must solve the 
constant-coefficient differential equation, Eq. (3.9). If the reader has little or no 
background in differential equations, it will be helpful to read through Appendix 
C before continuing. Appendix C reviews the direct method for solving linear, 
constant-coefficient differential equations and can be used as a quick look-up 
of the theory of differential equations. In the material that follows, it is assumed 
that the reader has adequate background in solving linear, constant-coefficient 
differential equations. 

From the theory of differential equations, we know that output y(t) for 
Eq. (3.9) can be expressed as a sum of two components: 

y(t)= £i(0 + yJj) , (3.10) 

zero-input response zero-state response 

where y z i(t) is the zero-input response of the system and y zs (t) is the zero- 
state response of the system. Note that the zero-input component y z i(t) is the 
response produced by the system because of the initial conditions (and not due 
to any external input), and hence y z \{t) is also known as the natural response 
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of the system. For example, the initial conditions may include charges stored 
in a capacitor or energy stored in a mechanical spring. The zero-input response 
y z i(t) is evaluated by solving a homogeneous equation obtained by setting the 
input signal x(t) = 0 in Eq. (3.9). For Eq. (3.9), the homogeneous equation is 
given by 

Q(D)y(f) = 0. 

The zero-state response y zs (f ) arises due to the input signal and does not depend 
on the initial conditions of the system. In calculating the zero-state response, 
the initial conditions of the system are assumed to be zero. The zero-state 
response is also referred to as the forced response of the system since the zero- 
state response is forced by the input signal. For most stable LTIC systems, the 
zero-input response decays to zero as t — > oo since the energy stored in the 
system decays over time and eventually becomes zero. The zero-state response, 
therefore, defines the steady state value of the output. 

Example 3.2 

Consider the RLC series circuit shown in Fig. 3.1. Assume that the inductance 
L = 0H (i.e. the inductor does not exist in the circuit), resistance R = 5 Q, 
and capacitance C = 1 /20 F. Determine the output signal y(t) when the input 
voltage is given by x(t) = sin(2f) and the initial voltage y(0“) = 2 V across 
the resistor. 

Solution 

Substituting L = 0, R = 5, and C = 1/20 in Eq. (3.7) yields 
dy dx 

— + 4y(f)= — = 2cos(2r). (3.11) 

dr dr 

Zero-input response of the system Using the procedure outlined in Appendix 
C, we determine the characteristic equation for Eq. (3.11) as 

(s + 4) = 0, 

which has a root at s = —4. The zero-input response of Eq. (3.1 1) is given by 
zero input response y z ;(f) = /I e 4 ' , 

where A is a constant. The value of A is obtained from the initial condition 
y(0 _ ) = 2 V. Substituting y(0”) = 2 V in the above equation yields A = 2. 
The zero-input response is given by y z i(t) = 2e 4 ' . 

Zero-state response of the system The zero-state response is calculated by 
solving Eq. (3.11) with a zero initial condition, y(0~) = 0. The homogeneous 
component of the zero-state response of Eq. (3.1 1) is similar to the zero input 
response and is given by 


yg(t) = Ce- 4 ', 


108 


Part II Continuous-time signals and systems 


where C is a constant. The particular component of the zero-state response of 
Eq. (3.11) for input x(t) = sin(2r) is of the following form: 

y%\t) = K x cos(2 1 ) + K 2 sin(2 1). 

Substituting the particular component in Eq. (3.11) gives Ki = 0.4 and K 2 = 
0.2. The overall zero-state response of the system is as follows: 

zero state response _y zs (f) = Ce~ 4 ' + 0.2 sin(2f) + 0.4 cos(2 f), 

with zero initial condition, i.e. y zs (t) = 0. Substituting the initial condition in 
the zero-state response yields C = —0.4. The total response of the system is 
the sum of the zero-input and zero-state responses and is given by 

y(t)= 1.6e~ 4 ' + 0.2 sin(2?) + 0.4 cos(2f). (3.12) 

Theorem 3.1 states the total response of a LTIC system modeled with a first- 
order, constant-coefficient, linear differential equation. 


Theorem 3.1 The output of a first-order differential equation, 

dy 


- 7 - + f{t)y{t) = r{t), 
at 


resulting from input r(t) is given by 


f 


e p r d t + c 


y(t) = e p 
where function p is given by 

P(t) = J f(t)dt 


(3.13) 


(3.14) 


(3.15) 


and c is a constant. 

Using Theorem 3.1 to solve Eq. (3.11), we obtain p{t) = f 4 dt = At. Substi- 
tuting p(t) = At into Eq. (3.14), we obtain 

J e 4 '2cos(2r)dr + c , 

where the integral simplifies to (see Section A. 5 of Appendix A) 

2 ( e 4 ' cos(2r)dr = — 7[4e 4 ' cos(2r) + 2e 4 ' sin(2r)]. 

J 2 2 + A 2 

Based on Theorem 3.1, the output is therefore given by 

y(t) = ce~ 4 ' + 0.2 sin(2r) + 0.4cos(2r). 

The value of constant c in the above equation can be computed using the initial 
condition. Substituting y(0~) = 2 V gives c — 1.6. The result is, therefore, the 
same as the solution in Eq. (3.12) obtained by following the formal procedure 
outlined in Appendix C. 


y(t) = e~ 4 ' 
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Steady state value of the output The steady state value of y {t ) can be obtained 
by applying the limit ( t —*■ oo) to y(t). For the differential equation (3.11), the 
steady state solution is therefore obtained by applying the limit to Eq. (3.12), 
giving 

y(t ) = lim [\.6sT‘ Xt + 0.2 sin(2r) + 0.4cos(2f)] = 0.2 sin(2f) + 0.4cos(2f), 

t— 

or 

y(t ) = yj 0.4 (i) 2 + 0.2 2 sin ^2t + tan _1 f = V 0.4 2 + 0.2 2 sin(2f + 63.4°) 

(3.16) 


The steady state solution given by Eq. (3.16) can also be verified using results 
from the circuit theory. For sinusoidal inputs, the electrical circuit in Fig. 
3.1 can be reduced to an equivalent impedance circuit by replacing capaci- 
tor C with a capacitive reactance of l/(ja >C) and inductor L with an induc- 
tive reactance of j wL, where o> is the fundamental frequency of the input 
sinusoidal signal x(t) = sin(2f). In our example, co = 2. Figure 3.1, therefore, 
becomes a voltage divider circuit with the steady state value of the output y(t) 
given by 


y(t) = 


R 

R + j wL + (1/j coC) 


x(t). 


(3.17) 


In Example 3.2, the values of the components are set to L = OH, R = 5 £2, and 
C = 1/20 F. Substituting these values into Eq. (3.17) yields 


yit) = 


(io/j) 


77 X(t) = 


1 


1 - J2 


sin(2r) = 


1 


1— j2 


sin(2r — Z(1 — j2)) 


= — — sin (it + tan : (2)) = \/0.2 sin(2t + 63.4°), 
v 5 


which is the same solution as given in Eq. (3.16). 


Example 3.3 

Consider the electrical circuit shown in Fig. 3.1 with the values of inductance, 
resistance, and capacitance set to L = 1/12 H, R = 7/ 12 C, and C = 1 F. The 
circuit is assumed to be open before t = 0, i.e. no current is initially flow- 
ing through the circuit. However, the capacitor has an initial charge of 5 V. 
Determine 

(i) the zero-input response w n (t) of the system; 

(ii) the zero-state response w zs (t) of the system; and 

(iii) the overall output H'(f), 

when the input signal is given by x(t ) = 2 exp (-t)u(t) and the output w(t) is 
measured across capacitor C . 
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Solution 

Substituting L = 1/12 H, R — 7/12 £2, and C = 1 F into Eq. (3.6) and multi- 
plying both sides of the equation by 12 yields 

d 2 w dw 

- T +7— + Uw(t)=l2x(t), (3.18) 

at- at 

with initial conditions, w(0~) = 5 and w(0~) = 0, and the input signal is given 
by x(t) = 2 e~'u(t). 

(i) Zero-input response of the system Based on Eq. (3.18), the characteristic 
equation of the LTIC system is given by 

s 2 + ls + \2 = 0, 

which has roots at s = —4, —3. The zero-input response is therefore given by 
w z i(f) = (Ae -4 ' + Be~ 3l )u(t), 

where A and B are constants. To calculate the value of the constants, we sub- 
stitute the initial conditions w(0 _ ) = 5 and vi’(0 — ) = 0 in the above equation. 
The resulting simultaneous equations are as follows: 

A + B = 5, 

4A + 3B = 0, 

which have the solution A = — 15 and B — 20. The zero-input response is 
therefore given by 

w z ;(f) = (20e~ 3 ' — 15 e _4f )«(0- 

(ii) Zero-state response of the system To calculate the zero-state response 
of the system, the initial conditions are assumed to be zero, i.e. the capaci- 
tor is assumed to be uncharged. Hence, the zero-state response w zs (r) can be 
calculated by solving the following differential equation: 

d 2 w dw 

__ +7 _ + 12w(0= 12x(t), (3.19) 

with initial conditions, w(0~) = 0 and vi’(0~) = 0, and input x{t) = 
2 exp (-t)u(t). 

The homogeneous solution of Eq. (3.18) has the same form as the zero-input 
response and is given by 


w®(0 = C ie - 4f + C 2 e- 3f , 

whereCi and C 2 are constants. The particular solution for input x{t) = 2e ' u(t) 
is of the form w z ^ \t) = Ks~'u(t). Substituting the particular solution into 
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Eq. (3.19) and solving the resulting equation yields K — 4. The zero-state 
response of the system is, therefore, given by 

w Z s(0 = (Cie + C 2 e ^ + 4e ’)u(t). 

To compute the values of constants C\ and C 2 , we use the initial conditions 
w(0~) = 0 and vi’(0 - ) = 0. Substituting the initial conditions in w zs (t) leads to 
the following simultaneous equations: 

Ci+C 2 + 4 = 0, 

-4Ci - 3C 2 - 4 = 0, 

with solutions Ci = 8 and C 2 = —12. The zero-state solution of Eq. (3.18) is, 
therefore, given by 

w zs (r) = (8e~ 4 ' - 12e" 3 ' + 4e~‘)u(t). 

(iii) Overall response of the system The overall response of the system can 
be obtained by summing up the zero-input and zero-state responses, and can be 
expressed as 

w(t ) = (— 7e~ 4 ' + 8e -3 ' + 4 e,~')u(t). 

The zero-input, zero-state, and overall responses of the system are plotted in 
Fig. 3.2. 

Section 3.1 presented the procedure for calculating the output response of a 
LTIC system by directly solving its input-output relationship expressed in the 
form of a differential equation. However, there is an alternative and more con- 
venient approach to calculate the output based on the impulse response of a 
system. This approach is developed in the following sections. 
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Fig. 3 . 3 . Approximation of a CT signal x(t) by a linear combination of time-shifted unit impulse functions, 
(a) Rectangular function 6 A (f ) used to approximate x(t). (b) CT signal x(t ) and its approximation x(t ) 
shown with the staircase function. 


3.2 Representation of signals using Dirac delta functions 


In this section we will show that any arbitrary signal x(t) can be represented as 
a linear combination of time-shifted impulse functions. To illustrate our result, 
we define a new function S A (?) as follows: 


«a(0 


1/A 0 < t < A 
0 otherwise. 


(3.20) 


The waveform for 8 A (t ) is shown in Fig. 3.3(a); it resembles that of a rectangular 
pulse with width A and height 1/ A. To approximate x(t) as a linear combination 
of <$ A (f), the time axis is divided into uniform intervals of duration A. Within a 
time interval of duration A, say kA < t < (k + 1)A, x(t) is approximated by 
a constant value x{kA)8 A {t — kA) A. Following the aforementioned procedure 
for the entire time axis, x (f) can be approximated as follows: 


x(t) — • • ■ T x ) — k A)8 A {t + k A) ■ A T ■ ■ ■ T x { — A)8 A (t -f- A) • A 
+ a:(0)<$a(1 ) ■ A + x(A)i5a(t — A) ■ A + • • • 

+ x(kA)8 A (t — kA) • A + • • • , (3.21) 


which is shown as the staircase waveform in Fig. 3.3(b). For a given value of t, 
say t = m A, only one term (k = m) on the right-hand side of Eq. (3.21) is non- 
zero. This is because only one of the shifted functions 8 A (t — kA) corresponding 
to k — m is non-zero. Therefore, a more compact representation for Eq. (3.21) 
is obtained by using the following summation: 

OO 

m = E x(kA)8 A (t — kA)A. 

k= — oo 


(3.22) 
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Applying the limit A — > 0, x{t) converges to x(t), giving 

OO 

x(t) = lim Y x(kA)8&(t — kA) [(A: + 1)A — £A] , (3.23) 

A— >0 ' 

K = — oo 

which is the same as 

OO 

x{t) = J x{r)8(t — r)dr. (3.24) 

— OO 

Equation (3.24) is very important in the analysis of CT signals. It suggests that 
a CT function can be represented as a weighted superposition of time-shifted 
impulse functions. We will use Eq. (3.24) to calculate the output of an LTIC 
system. 

The above procedure used to prove Eq. (3.24) illustrates the physical sig- 
nificance of the equation. A more compact proof of Eq. (3.24), based on the 
properties of the impulse function, is presented below. 

Alternative proof for Eq. (3.24) 

In the following discussion, we present a simpler proof of Eq. (3.24), which 
uses the properties of impulse functions. We start with the right-hand side of 
Eq. (3.24): 

OO 

RHS = J x(x )8(t - r)dr. 

— OO 

Since 8(t - t) = 8(x - t), 

OO 

RHS = J x(x)8(x - t)dr. 

— OO 

Also, x(x)8(x - t) = x{t)8(x - t)\ therefore 

OO 

RHS = x(t) J 8(r — f)dr, 

— OO 

which equals x(t), as the area enclosed by the unit impulse function equals 
unity. 


3.3 Impulse response of a system 


In Section 3.1, a constant-coefficient differential equation is used to specify the 
input-output characteristics of an LTIC system. An alternative representation 
of an LTIC system can be obtained by specifying its impulse response. In this 
section, we will formally define the impulse response and illustrate how the 
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impulse response of an LTIC system can be derived directly from the differential 
equation modeling the LTIC system. 

Definition 3.1 The impulse response h(t) of an LTIC system is the output of the 
system when a unit impulse S(t) is applied at the input. Following the notation 
introduced in Eq. (2.1 ), the impulse response can he expressed as 

8(t) -* h(t) (3.25) 

with zero initial conditions. Because the system is LTIC, it satisfies the linearity 
and the time-shifting properties. If the input is a scaled and time-shifted impulse 
function a8(t — to), the output, Eq. (3.25), of the system is also scaled by the 
factor of a and is time-shifted by to, i.e. 

a8(t — to) — > ah(t — to) (3.26) 

for any arbitrary constants a and to- 


Example 3.4 

Calculate the impulse response of the following systems: 

(i) y(t) = x(t - 1) + 2 x(t - 3); (3.27) 

(ii) ^ + Ay(t) = 2x(t). (3.28) 

dr 


Solution 

(i) The impulse response of a system is the output of the system when the input 
signal x(t) = 8(t). Therefore, the impulse response h(t) can be obtained by 
substituting y(t) by h(t) and x(t) by S(t) in Eq. (3.27). In other words, 

h(t) = 8(t - 1) + 2<$(r - 3). 


(ii) For input x(t) = 8(t), the resulting output y(t) = h(t). The impulse 
response h(t) can therefore be obtained by solving the following differential 
equation: 

^ + 4/2 (r) = 2 3(r) (3.29) 

dr 


obtained by substituting x(t) — 8(t) and y(t) = h(t) in Eq. (3.28). We will use 
Theorem 3.1 to compute the solution of Eq. (3.29). From Eq. (3.14), p(t) is 
given by 



4 dr = 4r, 


which is substituted into Eq. (3.15), giving 


/?(r) = e 


—At 


[’/ 


e 4? <5(r)dr + c 


= 2e 4 'w(r) + ce 4 ', 


-At 


(3.30) 
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-2 -1 012345678 9 -2 -1 0123456789 

(a) (b) 


Fig. 3.4. (a) Impulse response 
h(t ) of the LTIC system specified 
in Example 3.5. (b) Output y(t) 
of the LTIC system for input 

x(t) = 6(f + 1) + 36 (7 - 2) + 
26 (f - 6) . 


where constant c is determined from the zero initial condition. Substituting 
h(t) — 0 for 7 = 0 _ , in Eq. (3.30) gives c = 0. The impulse response of the 
system in Eq. (3.28) is therefore given by /i(7) = 2exp(— 4 t)u(t). 

Example 3.5 

The impulse response of an LTIC system is given by h{t) = exp(— 3 t)u(t). 
Determine the output of the system for the input signal x{t) = <5(7 + 1) + 
3S(t - 2) + 2 S(t - 6). 


Solution 

Because the system is LTIC, it satisfies the linearity and time-shifting properties. 
Therefore, 


<5(7 + 1) h(t + 1), 

3 <5(7 - 2) -► 3 hit - 2), 


and 


25(7 - 6) 2/i(7 - 6). 

Applying the superposition principle, we obtain 

x(t) -» y(7) = h(t + 1) + 3/i(7 - 2) + 2/i(7 - 6). 

The impulse response /i(7) is shown in Fig. 3.4(a) with the resulting output 
shown in Fig. 3.4(b). 
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3.4 Convolution integral 


In Section 3.3, we computed the output y(t) of an LTIC system from its impulse 
response h(t) when the input signal x(t) can be represented as a linear combi- 
nation of scaled and time-shifted impulse functions. In this section, we extend 
the technique to general input signals. 

Following the procedure of Section 3.2, an arbitrary CT signal x(t) can be 
approximated by the staircase approximation illustrated in Fig. 3.3. In terms of 
Eq. (3.23), the approximated function x(t) is given by 

OO 

x(t) = ^ x(kA)8&(t — kA)A. 

k = — oo 

Note that as A -> 0, the approximated Dirac delta function S A (t - kA) 
approaches 8(t - kA). Therefore, 

lim 8&(t — kA) -* lim hit — kA). 

A— >0 A— »0 

Multiplying both sides by x(k A) A, we obtain 

lim x(kA)8^(t — kA) x A — » lim x(kA)h(t — kA) x A. (3.31) 

A— >-0 A— >0 

Applying the linearity property of the system yields 



(3.32) 


As A — > 0, the summations on both sides of Eq. (3.32) become integrations. 
Substituting kA by r and A by dr, we obtain the following relationship: 


OO 

J x(r)8(t — r)dr 


OO 

J x(r)h(t — r)dr, 


— OO 


— OO 


(3.33) 


or 


x(t) 


OO 

/ 


x(r )h(t — r)dr, 


(3.34) 


where r is the dummy variable that disappears as the integration with limits 
is computed. The integral on the left-hand side of Eq. (3.34) is referred to 
as the convolution integral and is denoted by x(t) * h(t). Mathematically, the 
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Fig. 3.5. Output response of a 
system to a general inputx(f). 

x(t) = 

oo 

J x(T)<5(t - r)dr 


LTIC system 


► 


h(t) 


► 


y(t) = x(t)*h(t) = 

OO 

J x(r)h{t-T)dr 


convolution of two functions x(t) and h(t) is defined as follows: 

OO 

x(t)*h{t)= J x(r)h(t — r)dr. (3.35) 

— OO 

Combining Eqs. (3.34) and (3.35), we obtain the following: 

OO 

x(t) —> x{t) * hit) = J x(r) h(t — r)dr . (3.36) 

— OO 

Equation (3.36) is illustrated in Fig. 3.5 and can be reiterated as follows. When 
an input signal x(t) is passed through an LTIC system with impulse response 
h(t), the resulting output y(t) of the system can be calculated by convolving 
the input signal and the impulse response. 

We now consider several examples of computing the convolution integral. 

Example 3.6 

Determine the output response of an LTIC system when the input signal is given 
by x(t) — exp (-t)u(t) and the impulse response is h(t) = exp(— 2 t)u{t). 


Solution 

Using Eq. (3.36), the output y(t ) of the LTIC system is given by 


y(t) = J e T u(r)e T \i(t — r)dr, 


which can be expressed as 


y{t) = e~ 2 ' 


oo 

J e T u(t — r)dr. 

o 


Expressed as a function of the independent variable r, the unit step function is 
given by 


Based on the value of r, we have the following two cases for the output y(t). 
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Fig. 3.6. The output of a LTIC 
system with impulse response 
h(t) = exp(-2f)u(f) resulting 
from the input signal x (f ) = 
exp (-t)u(t) as calculated in 
Example 3.6. 



Case I For / < 0, the shifted unit step function u(t — r) = 0 within the limits 
of integration [0, oo]. Therefore, y(t) = 0 for t < 0. 

Case II For t > 0, the shifted unit step function u(t — r) has two different 
values within the limits of integration [0, oo]. For the range [0, f], the unit step 
function u(t — r) = 1. Otherwise, for the range |f, oo], the unit step function 
is zero. The output y(t) is therefore given by 

t 

y(t ) = e" 2 ' J e T dr = e~ 2 ' [e' — l] = e -t — e~ 2f , for t > 0. 
o 

Combining cases I and II, the overall output y(t ) is given by 
y(t) = ( e_, - e~ 2t )u(t). 

The output response of the system is plotted in Fig. 3.6. 

Example 3.6 shows us how to calculate the convolution integral analytically. In 
many practical situations, it is more convenient to use a graphical approach to 
evaluate the convolution integral, and we consider this next. 


3.5 Graphical method for evaluating the convolution integral 


Given input xit ) and impulse response hit) of the LTIC system, Eq. (3.36) can 
be evaluated graphically by following steps (1) to (7) listed in Box 3.1. 


Box 3.1 Steps for graphical convolution 

(1) Sketch the wavefonn for input x(r) by changing the independent vari- 
able from t to r and keep the waveform forx(r) fixed during convolution. 

(2) Sketch the waveform for the impulse response h( t) by changing the 
independent variable from t to r . 

(3) Reflect h( r) about the vertical axis to obtain the time-inverted impulse 
response h{— r). 
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(4) Shift the time-inverted impulse function /;(— r) by a selected value of 
“t.” The resulting function represents h(t — r). 

(5) Multiply function x(x) by h(t — r) and plot the product function 
x(x)h(t — r). 

(6) Calculate the total area under the product function x(x)h(t — r) by inte- 
grating it over r = [— oo, oo]. 

(7) Repeat steps 4—6 for different values of t to obtain y(t) for all time, 
— oo < t < oo. 


Example 3.7 

Repeat Example 3.6 and determine the zero-state response of the system using 
the graphical convolution method. 


Functions x(x) = exp(— x)u(x), h{ r) = exp(— 2x)u(x), and /?(— r) = 
exp(— 2r)w(— r) are plotted, respectively, in Figs. 3.7(a)-(c). The function 
h(t — r) = /;(— (r — t )) is obtained by shifting /?(— r) by time t. We consider 
the following two cases of t. 

Case 1 For t < 0, the waveform h(t — r) is on the left-hand side of the vertical 
axis. As is apparent in Fig. 3.7(e), waveforms for h(t — r) and x(r) do not 
overlap. In other words, x{x)h(t — x) = 0 for all r, hence y(t) = 0. 

Case 2 For t > 0, we see from Fig. 3.7(f) that the non-zero parts of h(t — r) 
and x(r) overlap over the duration t = [0, t ]. Therefore, 


Solution 



o 


0 


Combining the two cases, we obtain 



t < 0 
t > 0, 


which is equivalent to 


y(t) = (e ' - e 2, )u(t). 


The output y(t) of the FTIC system is plotted in Fig. 3.7(g). 
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Fig. 3.7. Convolution of the 
input signal x(t) with the 
impulse response h(t) in 
Example 3.7. Parts (a)-(g) are 
discussed in the text. 




Example 3.8 

The input signal x(t) = exp (-t)u(t) is applied to an LTIC system whose 
impulse response is given by 


h(t) = 


1 -t 0 < t < 1 
0 otherwise. 


Calculate the output of the system. 


Solution 

In order to calculate the output of the system, we need to calculate the convo- 
lution integral for the two functions x(t) and h(t). Functions x{x), h(x), and 
/?(— r) are plotted as a function of the variable r in the top three subplots of 
Fig. 3.8(a)-(c). The function hit — r) is obtained by shifting the time-reflected 
function /?(— r) by t . Depending on the value of t, three special cases may 


arise. 
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(e) (f) 


Fig. 3.8. Convolution of the 
input signal x(t) with the 
impulse response h(t) in 
Example 3.8. Parts (a)-(g) are 
discussed in the text. 



Case 1 For t < 0, we see from Fig. 3.8(e) that the non-zero parts of h(t — r) 
and a'(t) do not overlap. In other words, output y(t) = 0 for t <0. 

Case 2 For 0 < t < 1 , we see from Fig. 3.8(f) that the non-zero parts of h(t — r) 
and a(t) do overlap over the duration r = [0, t\. Therefore, 

t t 

y(t ) = J x(x )h(t — r)dr = J e -r (l — t + r)dr 


= (l-0 


l l 

J e~ r dr + J re” r dr . 


integral I 


integral II 


122 


Part II Continuous-time signals and systems 


The two integrals simplify as follows: 

integral !=(! — ?) [-e^o = (1 - 0(1 - e"'); 


integral II = [—re 


= 1 


re 


ForO < t < 1, the output y(t) is given by 

y(t) = (1 - r - e“ f + re"') + (1 - e - ' - re - ') = (2 -t- 2e~‘). 

Case 3 For t > 1, we see from Fig. 3.8(g) that the non-zero part of h(t — r) 
completely overlaps x(r) over the region r = [t — 1, t]. The lower limit of 
the overlapping region in case 3 is different from the lower limit of the over- 
lapping region in case 2; therefore, case 3 results in a different convolution 
integral and is considered separately from case 2. The output y(t) for case 3 is 
given by 

t t 

y(t) = J x(r )h{t — r)dr = J e~ r (l — f + r)dr 

o t - 1 

t t 


= d-0 


J e T dr + J re T dr . 


i - 1 


i - 1 


integral I integral II 

The two integrals simplify as follows: 

integral I = (1 — f)[— 1 e~ T ]J_ 1 = (1 — f)(e~ (,_1) — e”'); 
integral II = [— re _r — e _r ]J_j = (t — l)e” ( ' _1) 

= re _(f_1) — re” f — e - '. 


— (r-l) . 


te 


For t > 1, the output y(t) is given by 

y(t) = (e~ ( '^ n — ?e _(f_1) — e - ' + ?e~') + (te~ (,_l) — re - ' — e”') 
= (e- ( '- 1) -2e-'). 

Combining the above three cases, we obtain 

0 t < 0 

y(t) = (2 - t - 2e - ') 0 < t < 1 

( e -( f -D - 2e"') t > 1, 

which is plotted in Fig. 3.9. 


Example 3.9 

Calculate the output for the following input signal and impulse response: 


x(t) = 


1.5 -2 < r < 3 
0 otherwise 


and h{t) = 


2 - 1 < t < 2 

0 otherwise. 
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Fig. 3.9. Output y(t) computed 
in Example 3.8. 



Solution 

Functions x(r), /?( r), /?(— r), and h(t — r) are plotted in Figs. 3. 10(a)— (d). 
Depending on the value of t, the convolution integral takes five different forms. 
We consider these five cases below. 

Case 1 (f < —3). As seen in Fig. 3.10(e), the non-zero parts of h(t — r) and 
x(r) do not overlap. Therefore, the output signal y(t) = 0. 

Case 2 (—3 < t < 0). As seen in Fig. 3.10(f), the non-zero part of h{t — r) 
partially overlaps with x(r) within the region r = [—2, t + 1], The product 
x(r )h(t — r) becomes a rectangular function in the region with an amplitude 
of 1.5 x 2 = 3. Therefore, the output for —3 < t < 0 is given by 

t+i 

y(t)= J 3dr = 3(f + 3). 

-2 

Case 3 (0 < t < 2). As seen in Fig. 3.10(g), the non-zero part of h{t — r) 
overlaps completely with x(r). The overlapping region is given by r = 
[t — 2, t + 1 ]. The product x(r)h(t — r) is a rectangular function with an ampli- 
tude of 3 in the region r = [t — 2, t + 1]. The output for 0 < t < 2 is given by 

r+l 



t—2 


Case 4 (2 < t < 5). The non-zero part of h(t — r) overlaps partially with x(r) 
within the region r = [t — 2, 3]. Therefore, the output for 2 < 1 < 5 is given 
by 


*>-/ 

t—2 


3 dr = 3(5 - t). 


Case 5 (t > 0). We see from Fig. 3.10(i) that the non-zero parts of h(t — r) 
and x(r) do not overlap. Therefore, the output y(t) = 0. 
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1.5 

X(T) 




-2 0 3 


> T 


2.0 

M T) 





W 


-10 2 


(a) 


(b) 


2.0 


h(~ t) 


2.0 


h(t-x) 


(c) 

case 1 : 1 < -3 


-2 0 1 


► T 


(d) 


(1-2) (1+1) 0 


► T 


2.0 - 


x(t), /i(l— t) 


1.5 


(1-2) (1+1) -2 0 

(e) 


► T 


case 2: -3 < 

1<0 


x(t), h(t- t) 
-2.0 







(1-2) -2( ?+ i)0 3 


► T 


(f) 


2.0 


x(t), h(t- T) 




1.5 






-2 (1-2) 0 (1+1) 3 

(g) 


Fig. 3.10. Convolution of the 
input signal x(t) with the 
impulse response h (f) in 
Example 3.9. Parts (a)-(i) are 
discussed in the text. 


case 4: 2 < l < 5 

x(t), h(t— t) 


1.5 











-2 0 (1-2) 3 (l+l) 


(h) 


case 5: l > 5 


1.5 


2.0 


x(t), h(t— t) 


(i) 


-2 0 3 (1-2) (1+1) 


-► T 


Combining the five cases, we obtain 


y(t) = 


0 t < -3 

3(r + 3) — 3 < f < 0 
9 0 < t < 2 

3(5-f) 2<t <5 

0 f > 5. 


The waveform for the output response is sketched in Fig. 3.11. 
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Fig. 3.11. Output y(t) obtained 
in Example 3.9. 



-6 -4 -2 0 2 4 6 8 


3.6 Properties of the convolution integral 


The convolution integral has several interesting properties that can be used to 
simplify the analysis of LTIC systems. Some of these properties are presented 
in the following discussion. 

Commutative property 


x\(t) * x 2 (t) = x 2 (t) * X\{t). (3.37) 

The commutative property states that the order of the convolution operands does 
not affect the result of the convolution. In calculating the output of an LTIC 
system, the impulse response and input signal can be interchanged without 
affecting the output. The commutative property can be proved directly from the 
definition of the convolution integral by changing the dummy variable used for 
integration. 

Proof 

By definition, 

OO 

xi (t)*x 2 (t)= J xi(r)x 2 (t — r)dr. 

— OO 

Substituting u = t - r gives 

— OO 

*<«).*«)= /*« 

OO 

By interchanging the order of the upper and lower limits, we obtain 

OO 

o=/, 1 (r-»ta(»)d„ =««>«,«). 

— OO 

Below, we list the remaining properties of convolution. Each of these properties 
can be proved by following the approach used in the proof for the commutative 
property. To avoid redundancy, the proofs for the remaining properties are not 
included. 
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Distributive property 

Xi (t) * [x 2 (t) + x 3 (?)] = X\(t) * x 2 {t) + Xi (0 * x 3 (t). (3.38) 

The distributive property states that convolution is a linear operation. 

Associative property 

Xi(t) * [x 2 (t) * x 3 (f)] = [Xi (t) * x 2 (t)] * x 3 (t). (3.39) 

This property states that changing the order of the convolution operands does 
not affect the result of the convolution integral. 

Shift property If x t (t) * x 2 (t) = g(t ) then 


Xl (t - 7\) * x 2 {t - T 2 ) = g(t - T\ - T 2 ), (3.40) 

for any arbitrary real constants T\ and T 2 . In other words, if the two operands of 
the convolution integral are shifted, then the result of the convolution integral 
is shifted in time by a duration that is the sum of the individual time shifts 
introduced in the operands. 

Duration of convolution Let the non-zero durations (or widths) of the con- 
volution operands x\ (?) and x 2 (t) be denoted by T\ and T 2 time units, respec- 
tively. It can be shown that the non-zero duration (or width) of the convolution 
xi (t) * x 2 (t) is T\ + T 2 time units. 

Convolution with impulse function 

x(t) * S(t - t 0 ) = x(t - t 0 ). (3.41) 

In other words, convolving a signal with a unit impulse function whose origin 
is at t — to shifts the signal to the origin of the unit impulse function. 

Convolution with unit step function 

OO t 

x(t) * u(t) = / x(r)u{t — r)dr = J x(r)dr. (3.42) 

— OO — OO 

Equation (3.42) states that convolving a signal x(f) with a unit step function 
produces the running integral of the original signal x{t) as a function of time t. 

Scaling property If y(f) = Xi(f) * x 2 (t), then y(at) = |o!|xi(af) * x 2 (at). In 
other words, if we scale the two convolution operands x\ (t) and x 2 {t) by a 
factor of a, then the result of convolution Xi (t ) * x 2 (t ) is (i) scaled by a and (ii) 
amplified by |or| to determine y(at). 
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3.7 Impulse response of LTIC systems 


In Section 2.2, we considered several properties of CT systems. Since an LTIC 
system is completely specified by its impulse response, it is therefore logical to 
assume that its properties are completely determined from its impulse response. 
In this section, we express some of the basic properties of LTIC systems defined 
in Section 2.2 in terms of the impulse response of the LTIC systems. We consider 
the memorylessness, causality, stability, and invertibility properties for such 
systems. 


3.7.1 Memoryless LTIC systems 

A CT system is said to be memoryless if its output y(t) at time t = to depends 
only on the value of the applied input signal x(t) at the same time instant 
t = to- In other words, a memoryless LTIC system typically has an input-output 
relationship of the form 

y(t) = kx(t), 

where k is a constant. Substituting x(t ) = 8(t), the impulse response hit) of a 
memoryless system can be obtained as follows: 

hit) = kS(t). (3.43) 


An LTIC system will be memoryless if and only if its impulse response 
h(t ) = 0 for t ^ 0. 


3.7.2 Causal LTIC systems 

A CT system is said to be causal if the output at time t = to depends only on 
the value of the applied input signal x(t) at and before the time instant t = t () . 
The output of an LTIC system at time t = to is given by 

OO 

y(to)= J x{T)h{t 0 — r)dr . 

— OO 

In a causal system, output y{to) must not depend on x(r) for r > to. This 
condition is only satisfied if the time-shifted and reflected impulse response 
h{to — r) = 0 for r > to . Choosing to = 0, the causality condition reduces to 
h(— r) = 0 for r > 0, which is equivalent to stating that h{r) = 0 for r < 0. 
Below we state the causality condition explicitly. 


An LTIC system will be causal if and only if its impulse response h{t) = 0 
for t < 0. 
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3.7.3 Stable LTIC systems 

A CT system is BIBO stable if an arbitrary bounded input signal produces a 
bounded output signal. Consider a bounded signal x{t ) with \x(t)\ < B x for all 
t, applied as input to an LTIC system with impulse response h(t ). The magnitude 
of output y{t) is given by 


lv(OI = 


oo 

J h(r)x(t — r)dr . 

— OO 


Using the Schwartz inequality, we can say that the output is bounded within the 
range 

oo 

|y(OI < j \h(r)\\x(t — r)|dr. 

— OO 


Since x (t) is bounded, \x(t)\ < B x , therefore the above inequality reduces to 

OO 

|V(0| < B x j |/i(r)|dr. 

— OO 


It is clear from the above expression that for the output y{t) to be bounded, i.e. 
| y(f)| < oo, the integral / /?(r)dr within the limits [— 00 , 00 ] should also be 
bounded. The stability condition can, therefore, be stated as follows. 


If the impulse response h(t) of an LTIC system satisfies the following 
condition: 

OO 

J |/KO|dr < 00 , (3.44) 

— OO 

then the LTIC system is BIBO stable. 


Example 3.10 

Determine if systems with the following impulse responses: 

(i) h(t) = S(t)-S(t- 2), 

(ii) h(t) = 2rect(f/2), 

(iii) h(t) — 2exp(— ^ At)u(t), 

(iv) h(t) — [1 — exp(— 4 t)]u(t), 


are memoryless, causal, and stable. 
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Solution 

System (i) 


Memoryless property. Since h (t ) ^ 0 for t ^ 0, system (i) is not memoryless. 
The system has a limited memory as it only requires the values of the input 
signal within three time units of the time instant at which the output is 
being evaluated. 

Causality property. Since h(t) — 0 for t < 0, system (i) is causal. 

Stability property. To verify if system (i) is stable, we compute the following 
integral: 

OO CO 

I \h(t)\dt = J |«(f) - S(t - 2)\dt 

— OO — CO 


< 


j |<5(f)|df + 


OO 

J \8(t - 2)|df = 2 < oo, 


— OO 


— OO 


which shows that system (i) is stable. 


System (ii) 

Memoryless property. Since h(t) ^ 0 for t ^ 0, system (ii) is not memory- 
less. 

Causality property. Since h{t) ^ 0 for t < 0, system (ii) is not causal. 
Stability property. To verify if system (ii) is stable, we compute the following 
integral: 

OO 1 

J |/7(r)|d? = J 2dr = 4<oo, 

— OO —1 

which shows that system (ii) is stable. 

System (iii) 

Memoryless property. Since h{t) ^ 0 for i / 0, system (iii) is not memo- 
ryless. The memory of system (iii) is infinite, as the output at any time 
instant depends on the values of the input taken over the entire past. 
Causality property. Since h{t) = 0 for t < 0, system (iii) is causal. 

Stability property. To verify that system (iii) is stable, we solve the following 
integral: 

OO OO 

j \h(t)\dt = J 2e- 4 'dt = -0.5 x [e~ 4r ]g° = 0.5 < oo, 

— OO 0 

which shows that system (iii) is stable. 

System (iv) 

Memoryless property. Since h(t) ^ 0 for t ^ 0, system (iv) is not memory- 
less. 

Causality property. Since h(t) = 0 for t < 0, system (iv) is causal. 
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Stability property. To verify that system (iv) is stable, we solve the following 
integral: 

OO OO 

J \h(t)\dt = J(l - e~ 4r )d t = [t - 0.25e” 4 ']“ = oo, 

— OO 0 

which shows that system (iv) is not stable. 


3.7.4 Invertible LTIC systems 

Consider an LTIC system with impulse response hit). The output ji(t) of 
the system for an input signal x(t) is given by yi(t) = x it) * hit). For the 
system to be invertible, we cascade a second system with impulse response 
h[(t) in series with the original system. The output of the second system is 
given by 


yiit) = yi(t)*hi(t). 

For the second system to be an inverse of the original system, output _V 2 (0 should 
be the same as x{t). Substituting y\(t) = x(t) * hit) in the above expression 
results in the following condition for invertibility: 

x(t ) = [x(t) * h(t )] * hi(t) = x(t) * [, h(t ) * hi(t)]. 

The above equation is true if and only if 

h(t) * hi(t) = S(t). (3.45) 

The existence of h[(t) proves that an LTIC system is invertible. At times, it is 
difficult to determine the inverse system hi(t) in the time domain. In Chapter 5, 
when we introduce the Fourier transform, we will revisit the topic and illustrate 
how the inverse system can be evaluated with relative ease in the Fourier- 
transform domain. 

Example 3.11 

Determine if systems with the following impulse responses: 

(i) h(t) = S(t- 2), 

(ii) h{t) = S{t) - Sit - 2), 

are invertible. 

Solution 

(i) Since Sit — 2) * Sit + 2) = Sit), system (i) is invertible. The impulse 
response of the inverse system is given by 


hi(t) = 8(t + 2). 
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(ii) Assuming that the impulse response of the inverse system is hid), the 
stability condition is expressed as 

h(t) * hi (t) = [5(0 - S(t - 2)] * hi(t) = 5(0- 

By applying the convolution property, Eq. (3.41), the above expression simpli- 
fies to 

hi(t) ~ hid - 2) = 5(0 
or 

hid ) = 5(0 + hid - 2). 

The above expression can be solved iteratively. For example, h\d — 2) is given 
by 

hid - 2) = Sd - 2) + hdt - 4). 

Substituting the value of hid — 2) in the earlier expression gives 

hid) = Sd) + Sd - 2) + hid - 4), 

leading to the iterative expression 

OO 

hid)=J2 S d~ 2m )- 

m = 0 

To verify that hid) is indeed the impulse response of the inverse system, we 
convolve hd) with h,(t). The resulting expression is as follows: 

OO 

hd) * hid) = [ 5(0 - Sd ~ 2 )] * J2 8 V ~ 2m )’ 

m= 0 

which simplifies to 

OO OO 

hd) * hid) — Sd) * Sd — 2m) + 5(r — 2) * 5(r — 2m) 


hd) * hid) = Sd — 2m) + 5(f — 2 — 2m) = Sd)- 

m = 0 m = 0 

Therefore, hid) is indeed the impulse response of the inverse system. 


3.8 Experiments with Matlab 


In this chapter, we have so far presented two approaches to calculate the output 
response of an LTIC system: the differential equation method and the convolu- 
tion method. Both methods can be implemented using Matlab . However, the 
convolution method is more convenient for Matlab implementation in the 
discrete-time domain and this will be presented in Chapter 8. In this section, 


132 


Part II Continuous-time signals and systems 


therefore, we present the method for constant-coefficient differential equations 
with initial conditions. 

Matlab provides several M-files for solving differential equations with 
known initial conditions. The list includes ode23, ode45, odell3, odel5s, 
ode2 3s, ode2 3t, and ode2 3tb. Each of these functions uses a finite- 
difference-based scheme for discretizing a CT differential equation and iterates 
the resulting DT finite-difference equation for the solution. A detailed analysis 
of the implementations of these Matlab functions is beyond the scope of the 
text. Instead we will focus on the procedure for solving differential equations 
with Matlab. Since the syntax used to name these M-files is similar, we 
illustrate the procedure for the function call using ode2 3. Any other M-hle 
can be used instead of ode2 3 by replacing ode23 with the selected M-file. 
We will solve first- and second-order differential equations, and we compare 
the computed values with the analytical solution derived earlier. 

Example 3.12 

Compute the solution y(r) for Eq. (3.1 1), reproduced below for convenience: 
dy 

— + 4 y(r) = 2cos(2r)w(r), 
dr 

with initial condition y(0) = 2 for 0 < t < 15. Compare the computed solution 
with the analytical solution given by Eq. (3.12). 

Solution 

The first step towards solving Eq. (3.11) is to create an M-file containing the 
differential equation. We implement a reordered version of Eq. (3.11), given by 

dy 

— = — 4v(r) + 2cos(2 t)u(t), 
dr 

where the derivative dy/dr is the output of the M-file based on the input y and 
time r. Calling the M-file my fund, the format for the M-file is as follows: 

function [ydot] = myfuncl ( t , y) 

% MYFUNC1 

% Computes first derivative in (3.11) given the value of 
% signal y and time t. 

% Usage: ydot = myfuncl (t,y) 
ydot = -4*y + 2*cos (2*t) . * (t >= 0) 

The above function is saved in a file named myfuncl . m and placed in a direc- 
tory included within the defined paths of the Matlab environment. To solve 
the differential equation defined in myfuncl over the interval 0 < t < 15, 
we invoke ode 2 3 after initializing the input parameters in an M-file as 
shown: 
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Fig. 3.12. Solution y(t) for Eq. 
(3.11) computed using Matlab. 



time 


% Matlab program to solve Equation (3.11) in Example 3.12 
tspan = [0:0.01:15]; % duration with resolution 

% of 0.01s. 

yO = [2]; % initial condition 

[t,y] = ode23 ( 'myfuncl ' , tspan,y0); 

% solve ODE using ode23 

plot(t,y) % plot the result 

xlabel ( ' time ' ) % Label of X-axis 

ylabel ( 'Output Response y ( t ) ' ) % Label of Y-axis 


The final plot is shown in Fig. 3.12 and is the same as the analytical solution 
given by Eq. (3.12). 


Example 3.13 

Compute the solution for the following second-order differential equation: 


y(t) + 5 y(t) + 4 y(t) = (3 cos t)u(t) with initial conditions 

y(0) = 2 and y(0) = -5, 


for 0 < t <20 using M A T L A B . N ote that the analytical solution of this problem 
is presented in Appendix C (see Example C.6). 


Solution 

Higher-order differential equations are typically represented by a system of first- 
order differential equations before their solution can be computed in Matlab . 
Assuming y 2 (0 to be the solution of the aforementioned differential equation, 
we obtain 

3*2(0 + 5y 2 (t) + 4y 2 (t) = (3 cos t)u(t). 

To reduce the second-order differential equation into a system of two first-order 
differential equations, assume the following: 


>’2(0 = >h(0- 


(3.46) 
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Substituting y 2 (0 in the original equation and rearranging the terms yields 

yi (t) = -5yi(0 - 4y 2 (0 + (3 cos t)u(t). (3.47) 

Equations (3.46) and (3.47) collectively define a system of first-order differ- 
ential equations that simulate the original differential equation. The coupled 
system can be represented in the matrix-vector form as follows: 

’ yi(0 
.>'2(0 

To simulate the above system, we write an M-file myfunc2 that computes 
the vector of derivatives on the left-hand side of Eq. (3.48) based on the input 
parameters t and vector y that contains the values of y\ and y 2 : 

function [ydot] = myfunc2(t,y) 

% The function computes first derivative of (3.48) from 
% vector y and time t. 

% Usage: ydot = myfunc2(t,y) 

ydot (1,1) = -5*y ( 1 ) - 4*y(2)+ 3*cos(t)*(t >= 0); 
ydot (2 , 1) = y (1) ; 

% end of the function 

Note that the output of the above M-file is the column vector ydot corre- 
sponding to Eq. (3.48). The M-file myfunc2 ,m should be placed in a direc- 
tory included within the defined paths of the Matlab environment. To solve 
the differential equation defined in myf unc2 over the interval 0 < t < 20, we 
invoke ode23 after initializing the input parameters as given below: 

% Matlab program to solve Example 3 . 13 

tspan = [0:0.02:20]; % duration with resolution of 

% 0.02s. 

yO = [-5; 2]; % initial conditions 

[t,y] = ode23 ( 'myfunc2 ' , tspan, yO); 

% solve ODE using ode23 

plot ( t , y ( : , 2 ) ) % plot the result 

Note that the order of the initial conditions is reversed such that j 2 (0) = — 5 is 
mentioned first and v 2 (0) = 2 later in the initial condition vector yO. Looking 
at the structure of Eq. (3.48), it is clear that the top entry in the first row of ydot 
corresponds to >i(f), which is equal to y 2 (f). Similarly, the entry in the second 
row of ydot contains the value of > 2 (f). The function ode2 3 will integrate 
ydot returning the value in y. The vector y, therefore, contains the values 
of > 2 (t) in the top row and the values of > 2 (f) in the bottom row. The order 
of the initial conditions is adjusted according to the returned values such that 
y 2 (0) = —5 is mentioned first and y 2 (0) = 2 later in the initial condition vector 
yO. The solution of the differential equation is also contained in the second 
column of vector y. 


-5>i(f) - 4 y 2 (t) + (3 cos t)u(t) 

>i(0 


(3.48) 
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Fig. 3.13. Solution y(t) for 
Example 3.13 computed using 
Matlab. 



time 


The solution y(t) is plotted in Fig. 3.13. It can be easily verified that the 
plot is same as the analytical solution given by Eq. (C.38), which is reproduced 
below 

1 21 ,, 9 15 

y(t) = -e H e H cos t H sin t for t > 0. 

J 2 17 34 34 


3.9 Summary 


In Chapter 3, we developed analytical techniques for LTIC systems. We saw 
that the output signal y(t) of an LTIC system can be evaluated analytically in 
the time domain using two different methods. In Section 3.1, we determined the 
output of an LTIC by solving a linear, constant-coefficient differential equation. 
The solution of such a differential equation can be expressed as a sum of 
two components: zero-input response and zero-state response. The zero-input 
response is the output produced by the LTIC system because of the initial 
conditions. For stable LTIC systems, the zero-input response decays to zero 
with increasing time. The zero-state response is due to the input signal. The 
overall output of the LTIC system is the sum of the zero-input response and 
zero-state response. 

An alternative representation for determining the output of an LTIC system 
is based on the impulse response of the system. In Section 3.3, we defined the 
impulse response /?(/) as the output of an LTIC system when a unit impulse <5(0 
is applied at the input of the system. In Section 3.4, we proved that the output y(t) 
of an LTIC system can be obtained by convolving the input signal x(t) with its 
impulse response h(t). The resulting convolution integral can either be solved 
analytically or by using a graphical approach. The graphical approach was 
illustrated through several examples in Section 3.5. The convolution integral 
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satisfies the commutative, distributive, associative, time-shifting, and scaling 

properties. 

(1) The commutative property states that the order of the convolution operands 
does not affect the result of the convolution. 

(2) The distributive property states that convolution is a linear operation with 
respect to addition. 

(3) The associative property is an extension of the commutative property to 
more than two convolution operands. It states that changing the order 
of the convolution operands does not affect the result of the convolution 
integral. 

(4) The time-shifting property states that if the two operands of the convolution 
integral are shifted in time, then the result of the convolution integral is 
shifted by a duration that is the sum of the individual time shifts introduced 
in the convolution operands. 

(5) The duration of the waveform produced by the convolution integral is the 
sum of the durations of the convolved signals. 

(6) Convolving a signal with a unit impulse function with origin at t = to shifts 
the signal to the origin of the unit impulse function. 

(7) Convolving a signal with a unit step function produces the running integral 
of the original signal as a function of time t. 

(8) If the two convolution operands are scaled by a factor a , then the result of 
the convolution of the two operands is scaled by a and amplified by |a|. 

In Section 3.7, we expressed the memory less, causality, inverse, and stability 

properties of an LTIC system in terms of its impulse response. 

(1) An LTIC system will be memoryless if and only if its impulse response 
h{t) = 0 for t / 0. 

(2) An LTIC system will be causal if and only if its impulse response h{t) = 0 
for t < 0. 

(3) The impulse response of the inverse of an LTIC system satisfies the property 
hit) * h(t) = 5(f). 

(4) The impulse response h(t) of a (BIBO) stable LTIC system is absolutely 
integrable, i.e. 


OO 

|/z(t)|dr < oo. 

— OO 

Finally, in Section 3.8 we presented a few Matlab examples for solving 
constant-coefficient differential equations with initial conditions. 

In Chapters 4 and 5, we will introduce the frequency representations for CT 
signals and systems. Such representations provide additional tools that simplify 
the analysis of LTIC systems. 
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Problems 


3.1 Show that a system whose input x (?) and output y(f ) are related by a linear 
differential equation of the form 

d" -1 ’ 


d" v a""‘y 

“|” CLn — 1 T “I” 

dr" dr"- 1 


— bn 


d m x 

' d 7 ” 


+ b m - 1 


dv 

■•+«!— +a 0 y(t) 
dr 

d m ~ l x dx 

d^ + '" + bl d^' 


• b 0 x(t) 


is linear and time-invariant if the coefficients [a r , 0 < r < n — 1} and 
[b r , 0 < r < m} are constants. 


3.2 For each of the following differential equations modeling an LTIC system, 
determine (a) the zero-input response, (b) the zero-state response, (c) the 
overall response and (d) the steady state response of the system for the 
specified input x(t) and initial conditions. 

(i) y(t) + 4y(t) + 8y(f) = x(t) + x(t) with x(t) — e~ 4, u(t), 
y(0) = 0, and y(0) = 0. 

(ii) y{t) + 6y(t) + 4y(r) = x(t) + x(t) with x(t) — cos(6 t)u(t), 
y(0) = 2, and y(0) = 0. 

(iii) y(t) + 2 y(t) + y(t) — x(t ) with x (r ) = [cos(r) + sin(2r)]r<(r), 
y(0) = 3, and y(0) = 1. 

(iv) y{t) + 4y(r) = 5x(t) with x(t) — 4te~'u(t), y(0) = — 2, 
and v(0) = 0. 

(v) 'y(t) + 2 y(t) + y(t) = x(t) with x(t) — 2 u(t), y(0) — y(0) = 
y(0) = 0, and y(0) = 1. 

3.3 Find the impulse responses for the following LTIC systems character- 
ized by linear, constant-coefficient differential equations with zero initial 
conditions. 

(i) y(t) = 2 x(r); (iv) y(t) + 3 y(f) = 2i(r) + 3 x(t); 

(ii) y(t) + 6y(t) = x(t); (v) y(t) + 5y(f) + 4y(t) = *(r); 

(iii) 2y(r) + 5y(r) = x(t); (vi) y(t) + 2 y(t) + y(t) = x(t). 

3.4 The input signal x(t) — e a 'u(t) is applied to an LTIC system with impulse 
response h(t) = e~P' U (t). 

(i) Calculate the output y{t) when a ^ ft. 

(ii) Calculate the output y(t) when a — fi. 

(iii) Intuitively explain why the output signals are different in parts (i) and 

(ii). 


3.5 Determine the output y(t) for the following pairs of input signals x(t) and 
impulse responses h(t): 

(i) x(t) — u(t), h(t) = u(t); 

(ii) x(t) — u{—t ), hit) = u(—t); 

(iii) x(t) = u(t) — 2u(t — 1) + u{t — 2), h(t) = u(t + 1) — u(t — 1); 
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(iv) x(t ) = e 2f w(— t), h{t) — e~ 3, M(7); 

(v) x(t) — sin(27r/)(i/(r — 2) — u{t — 5)), h(t) — u(t) — u(t — 2); 

(vi) x (t) — e~ 2 ^, h(t) — e -5 ^; 

(vii) x (t) — sin (t)u(t), h(t) = cos (t)u(t). 


3.6 For the four CT signals shown in Figs. P3.6, determine the following 
convolutions: 

(vi) y 6 (t) = z(t)*w(t); 

(vii) y 7 (t) = z(t) * v(f); 

(viii) _y 8 (r) = w(t) * w(t); 

(ix) y 9 (t) = w(t) * v(f); 

(x) y 10 (t) = v(t) * v(f). 

3.7 Show that the convolution integral satisfies the distributive, associative, 
and scaling properties as defined in Section 3.6. 


(i) yi(t) = x(t) * x(t)-, 

(ii) y 2 (t) = x(t) * z(t); 

(iii) y 3 (t) = x(t) * w(f); 

(iv) y 4 (t) = x(t) * v(f); 

(v) ys (0 = z(f) * z(t); 


3.8 When the unit step function, u(t), is applied as the input to an LTIC sys- 
tem, the output produced by the system is given by y(t) = (1 — e ' )u(t). 

Determine the impulse response of the system. [Hint: If x(t) -> y(t ) then 
Ax/d t — > dy /dt (see Problem 2.15).] 


3.9 A CT signal x{t), which is non-zero only over the time interval, t = 
[—2, 3], is applied to an LTIC system with impulse response h(t). The 
output y(t) is observed to be non-zero only over the time interval t = 
[—5, 6], Determine the time interval in which the impulse response h(t) 
of the system is possibly non-zero. 


3.10 An input signal 



x(t) 


I ? 0 < t < 1 

0 otherwise 


is applied to an LTIC system whose impulse response is given by 
h(t) = s~'u(t). Using the result in Example 3.8 and the properties of 
the convolution integral, calculate the output of the system. 


Fig. P3.6. CT signals for 
Problem P3.6. 


3.11 An input signal g(t) — e (t 2) u(t — 2) is applied to an LTIC system whose 
impulse response is given by 


r(t) = 


5 — t 4< t < 5 
0 otherwise. 


Using the result in Example 3.8 and the properties of the convolution 
integral, calculate the output of the system. 

3.12 Determine whether the LTIC systems characterized by the following 
impulse responses are memoryless, causal, and stable. Justify your 
answer. For the unstable systems, demonstrate with an example that a 
bounded input signal produces an unbounded output signal. 
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Fig. P3.15. Feedback system for 
Problem P3.15. 



(i) 

A K0 

(ii) 

it 2(0 

(iii) 

A 3(0 

(iv) 

/?4(0 

(v) 

A5(0 

(vi) 

A6(0 

(vii) 

A7(0 

(viii) 

hm 

(ix) 

h%t) 


<5(0 + e~ 5, u(t); 

e~ 5 ' sin(2n t)u(t); 
e -21 ' 1 + u(t + 1) — u(t — 1); 
t[u(t + 4) — u{t — 4)]; 
sin 10? ; 

cos(50«(0; 

0.95 1 ' 1 ; 

1 -1 < t < 0 

-1 0 < t < 1 

0 otherwise. 


3.13 Consider the systems in Example 3.10. Analyzing the impulse responses, 
it was shown that the systems were not memoryless. In this problem, 
calculate the input-output relationships of the systems, and from these 
relationships determine if the systems are memoryless. 


3.14 Determine whether the LTIC systems characterized by the following 
impulse responses are invertible. If yes, derive the impulse response of 
the inverse systems. 

(i) /; 1(0 = 58(t - 2); (iv) h4(t) = «(0; 

(ii) A2(0 = .5(0 + 8(t + 2); (v) h5(t) = rect(r/8); 

(iii) /i3(0 = <5(r + 1) + 8(t - 1); (vi) h6(t) = e~ 2l u(t). 


3.15 Consider the feedback configuration of the two LTIC systems shown in 
Fig. P3.15. System 1 is characterized by its impulse response, /?i(0 = 
u(t). Similarly, system 2 is characterized by its impulse response, hi(t) = 
u(t). Determine the expression specifying the relationship between the 
input x(t) and the output y(t). 

3.16 A complex exponential signal x(t) = e’ 0 ' 0 ' is applied at the input of an 
LTIC system with impulse response h{t). Show that the output signal is 
given by 

y(t) = | m=Wo , 


where H(a>) is the Fourier transform of the impulse response hit) given 
by 


H(co) = 


J /7(0e- j “'dr. 


— OO 
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3.17 A sinusoidal signal x(t) = A sin(&>of + 0) is applied at the input of an 
LTIC system with real-valued impulse response h(t). By expressing the 
sinusoidal signal as the imaginary term of a complex exponential, i.e. as 

}A sin(ft>o? + 6) = 1m { Ae j( “ 0+ ' ) } , A e 1)1, 

show that the output of the LTIC system is given by 

y(r) = A\H(co 0 )\ sin (coot + 0 + arg (H(coo)), 

where H(a > ) is the Fourier transform of the impulse response h(t) as 
defined in Problem 3.16. 

Hint: If h(t) is real and x(t) -* y(t), then Im{jr(?)} — ► Im{y(r)}. 

3.18 Given that the LTIC system produces the output y(t) = 5 cos(2 jzt) when 
the signal x(t) = — 3sin(2^"r + 7r/4) is applied at its input, derive the 
value of the tranfer function II (o> ) at co = 2 tt . Hint: Use the result derived 
in Problem 3.17. 

3.19 (a) Compute the solutions of the differential equations given in P3.2 for 
duration 0 < t < 20 using Matlab . (b) Compare the computed solution 
with the analytical solution obtained in P3.2. 


CHAPTER 



Signal representation using 
Fourier series 


In Chapter 3, we developed analysis techniques for LTIC systems using the 
convolution integral by representing the input signal x(t) as a linear combi- 
nation of time-shifted impulse functions S(t). In Chapters 4 and 5, we will 
introduce alternative representations for CT signals and LTIC systems based on 
the weighted superpositions of complex exponential functions. The resulting 
representations are referred to as the continuous-time Fourier series (CTFS) 
and continuous-time Fourier transform (CTFT). Representing CT signals as 
superpositions of complex exponentials leads to frequency-domain characteri- 
zations, which provide a meaningful insight into the working of many natural 
systems. For example, a human ear is sensitive to audio signals within the fre- 
quency range 20 Hz to 20 kHz. Typically, a musical note occupies a much 
wider frequency range. Therefore, the human ear processes frequency com- 
ponents within the audible range and rejects other frequency components. In 
such applications, frequency-domain analysis of signals and systems provides 
a convenient means of solving for the response of LTIC systems to arbitrary 
input signals. 

In this chapter, we focus on periodic CT signals and introduce the CTFS used 
to decompose such signals into their frequency components. Chapter 5 considers 
aperiodic CT signals and develops an equivalent Fourier representation, CTFT, 
for aperiodic signals. The organization of Chapter 4 is as follows. In Section 4. 1 , 
we define two- and three-dimensional orthogonal vector spaces and use them 
to motivate our introduction to orthogonal signal spaces in Section 4.2. We 
show that sinusoidal and complex exponential signals form complete sets of 
orthogonal functions. By selecting the sinusoidal signals as an orthogonal set of 
basis functions, Sections 4.3 and 4.4 present the trigonometric CTFS for a CT 
periodic signal. Section 4.5 defines the exponential representation for the CTFS 
based on using the complex exponentials as the basis functions. The properties 
of the exponential CTFS are presented in Section 4.6. The condition for the 
existence of CTFS is described in Section 4.7. Several interesting applications 
of the CTFS are presented in Section 4.8, which is followed by a summary of 
the chapter in Section 4.9. 
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4.1 Orthogonal vector space 


From the theory of vector space, we know that an arbitrary M -dimensional 
vector can be represented in terms of its M orthogonal coordinates. For example, 
a two-dimensional (2D) vector V with coordinates (v, , v 7 ) can be expressed as 
follows: 


V = v l l + v J l (4.1) 

where i and j are the two basis vectors, respectively, along the x- and y-axis. A 
graphical representation for the 2D vector is illustrated in Fig. 4.1(a). The two 
basis vectors i and j have unit magnitudes and are perpendicular to each other, 
as described by the following two properties: 


orthogonality property 


■ j = \i \ ill cos 90° = 0; (4.2) 


\i ■ i = |/| \i cos0° = 1 

unit magnitude property { -> -, - - (4.3) 

l j ■ j = \j\ I;'|cos0° = l. 


In Eqs. (4.2) and (4.3), the operator (•) denotes the dot product between the two 
2D vectors. 

Similarly, an arbitrary three-dimensional (3D) vector V, illustrated in 
Fig. 4.1(b), with Cartesian coordinates (v,-, Vj, v^-), is expressed as follows: 


V= Vji + v,j 


nV 


v iJ 


(a) 


V = v t i + vjj + +v k k, (4.4) 

where i, j, and k represent the three basis vectors along the x-, y-, and z-axis, 
respectively. All possible dot product combinations of basis vectors satisfy the 
orthogonality and unit magnitude properties defined in Eqs. (4.2) and (4.3), i.e. 

orthogonality property i ■ j = i ■ k = k • j = 0: (4.5) 

unit magnitude property i ■ i = j ■ j = k -k = 1. (4.6) 



Fig. 4.1. Representation of 
multidimensional vectors in 
Cartesian planes: (a) 2D vector; 
(b) 3D vector. 


Collectively, the orthogonal and unit magnitude properties are referred to as 
the orthonormal property. Given vector V, coordinates v,, v ; , and v/, can be 
calculated directly from the dot product of vector V with the appropriate basis 
vectors. In other words, 


v« 


V-u _ |y||g|cosgfr, 
u ■ u \u\\u\ 


for u e {/, j, £}, 


(4.7) 


where 0y~ is the angle between V and u. Just as an arbitrary vector can be 
represented as a linear combination of orthonormal basis functions, it is also 
possible to express an arbitrary signal as a weighted combination of orthornor- 
mal (or more generally, orthogonal) waveforms. In Section 4.2, we extend the 
principles of an orthogonal vector space to an orthogonal signal space. 
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4.2 Orthogonal signal space 

Definition 4.1 Two non-zero signals pit) and q(t) are said to be orthogonal 
over interval t = [t\ , ^ 2 ] if 

h h 

J p(t)q*(t)dt = J p*it)q(t)dt = 0, (4.8) 

t\ h 

where the superscript * denotes the complex conjugation operator. In addition 
toEq. (4.8), if both signals p(t) andq(t) also satisfy the unit magnitude property: 

h h 

J p(t)p*(t)dt = J q(t)q*(t)dt = 1 . (4.9) 

h h 

they are said to be orthonormal to each other over the interval t = [t\, tf\. 

Example 4.1 

Show that 

(i) functions cos(2 jtt) and cos(37rf) are orthogonal over interval t = |0. 1 ]; 

(ii) functions exp(j2f) and exp(j4/) are orthogonal over interval t = [0, tt); 

(iii) functions cos(f) and t are orthogonal over interval t = [— 1, 1]. 


Solution 

(i) Using Eq. (4.8), we obtain 

1 1 


/ 


cos(2nt) cos(3jct)dt — - 


I 

0 


[cos(jrr) + cos(5^t)]dr 


1 1 

— sin(jrr) H sin(57rf) 

TT 5lt 


-T 1 


= 0. 


J 0 


Therefore, the functions cos(2 nt) and cosOtt/) are orthogonal over interval 
t = [0, 1]. 

Figure 4.2 illustrates the graphical interpretation of the orthogonality con- 
dition for the functions cos(2jrf ) and cosOtt? ) within interval t = [0, 1]. 
Equation (4.8) implies that the area enclosed by the waveform for cos(2jrf ) x 
cos(3 nt) with respect to the /-axis within the interval t = [0, 1], which is shaded 
in Fig. 4.2(c), is zero, which can be verified visually. 

(ii) Using Eq. (4.8), we obtain 

n tt 

J e j2 'e” j4 'dr = J e~ i2t dt = ~ [e~ i27T - 1]" = 0, 

0 0 


implying that the functions exp(j2f) and exp( j4f ) are orthogonal over interval 
t = [0, tt ] . 
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(a) 

Fig. 4.2. Graphical illustration of 
the orthogonality condition for 
the functions cos(27tf) and 
cos(37tf) used in Example 4.1 (i). 

(a) Waveform for cos(27tf). 

(b) Waveform for cos(37tf). 

(c) Waveform for cos(27tf ) x 
COS(37tf). 



-2 -1.5 -1 -0.5 0 0.5 1 1.5 2 

(b) 



-2 -1.5 -1 -0.5 0 0.5 1 1.5 2 

(c) 


(iii) Using Eq. (4.8), we obtain 

t 

J t cos(f)df = [f sin(f) + cos(f)] = [1 ■ sin(l) + cos(l)] 

-l 

- [(- 1) • sin(— 1) + cos( — 1)] = 0, 

implying that the functions cos(f) and f are orthogonal over interval f = [—1, 1], 
Further, it is straightforward to verify that these functions are also orthogonal 
over any interval t = [— L , L] for any real value of L. 

We now extend the definition of orthogonality to a larger set of functions. 


Definition 4.2 A set of N functions {pi(t), / 22 (f), . . . , pjv(0} is mutually 
orthogonal over the interval t = [fi, ? 2 ] if 


h 

J Pm(t)p*(t)dt = 


t\ 


E n 0 m = n 

0 m ^ n 


for 1 < m, n < N . 


(4.10) 


In addition, if E n = 1 for all n, the set is referred to as an orthonormal set. 


Definition 4.3 An orthogonal set {/21(f), /22(f), . . . , / 2 ;v(f)} is referred to as a 
complete orthogonal set if no function c/(t) exists outside the set that satisfies the 
orthogonality condition, Eq. (4.6), with respect to the entries p n (t), 1 < n < N, 
of the orthogonal set . Mathematically , function q(t) does not exist if 
h 

»! 

h 
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with 

h 

fqWMtO. (4.12) 

h 


Definition 4.4 If an orthogonal set is complete /or a certain class of orthogonal 
functions within interval t = [/, tf\, then any arbitrary function x(t ) can be 
expressed within interval t — [/, ti\ as follows: 

x(t) = cipi(t) + C 2 P 2 U) H h c n p n (t) H f c N p N {t), (4.13) 

where coefficients c n , n e [1, . . . , IV], are obtained using the following 
expression: 



The constant E„ is calculated using Eq. (4.10). The integral Eq. (4.14) is the 
continuous time equivalent of the dot product in vector space, as represented 
in Eq. (4.7). The coefficient c n is sometimes referred to as the nth Fourier 
coefficient of the function x(t). 

Definition 4.5 A complete set of orthogonal functions {p n (t)}, 1 < n < N .that 
satisfies Eq. (4.10) is referred to as a set o/'basis functions. 


Example 4.2 

For the three CT functions shown in Fig. 4.3 


(a) show that the functions form an orthogonal set of functions; 

(b) determine the value of T that makes the three functions orthonormal; 

(c) express the signal 


x(t) = 


A for 0 < t < T 
0 elsewhere 


in terms of the orthogonal set determined in (a). 


Fig. 4.3. Orthogonal functions 
for Example 4.2. 


< fe (0 


► 




(a) 


(b) 


(c) 
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Solution 

(a) We check for the unit magnitude and the orthogonality properties for all 
possible combinations of the basis vectors: 

T T T 


unit magnitude property 


J |0i(r)| 2 dr = J = I |0 3 (OI 2 dr 

-T -T -T 

T 

= J 1 dr = 2T- 

-T 


orthogonality property 


/ 

-T 

T 

J 


0i(fW>* 2 (Odr 




T 

= J <P* 2 (.mt = o, 

-T 

T 

= J 4>%m t = o, 

-T 


and 


T TO 

J = J 4>2(t)dt - J 0* 2 (t)dr = 0. 

-T 0 -T 


In other words, 

T 

J 4> m (t)4>*(t)dt 

-T 


2T ^0 m = n 
0 m ^ n. 


for 1 < m, n < 3. The three functions are orthogonal to each other over the 
interval [— T, T], 

(b) The three functions will be orthonormal to each other: 

T 


I 


<Pm(t)(p*(t)dt 


2T = 1 m = n 
0 m ^ n. 


-T 


which implies that T — 1/2. 

(c) Using Definition 4.4, the CT function x{t) can be represented as x(t) = 
c\4>\(t) + C 2 <p 2 (t) + C3</>3(7) with the coefficients c„, for n = 1 , 2, and 3 given by 

T T 

If If A 

-T 0 

T T 

Cl = Tf j = 2 T J ^^Odt 

-T 0 

T/2 T 

= — ( A dr- — [ A dr = 0, 

2 T J 2 T J 

0 T/2 
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and 


T T 

If If A 

C3 = 2 T J x{t ^^ t)dt = 2J J A(-1 ) df = ~2' 

-T 0 

In other words, x(t) = 0.5A[</>i(r) — (/ 73 (f)]. 

Example 4.3 

Show that the set {1, cos(&>oO, cos(2eoo0> cos(3a>of), . . . , sin(&>ot), sin(2&>of), 
sin(3tt)o0. • • • }, consisting of all possible harmonics of sine and cosine waves 
with fundamental frequency of a> o, is an orthogonal set over any interval 
t = [f 0 , to + 7o], with duration 7o = 2jr /coq. 

Solution 

It may be noted that the set {1, cos(<wof), cos(2&>of), cos(3<wo0> • • ■ , sin(&>of), 
sin(2&>o0> sin(3o)o0> •■■} contains three types of functions: 1 , {cos(»7&>o0}, 
and {sin(/?&>oO} for arbitrary integers m, n e Z + , where Z + is the set of positive 
integers. We will consider all possible combinations of these functions. 


Case 1 The following proof shows that functions {cosOwvoO, m e Z + } are 
orthogonal to each other over interval t = [fo, to + 7o] with Tq = 2n /u>o- 
Equation (4.10) yields 

lo+To 

I cos(ma>ot) cos(na>ot)dt = I cos(ma>ot)cos(ncoot)dt for any arbitrary to- 

(To) to 

Using the trigonometric identity cos(m&>ot) cos(«a>o0 = (l/2)[cos((w — 
n)wot) + cos((t 7 ? + n^coot )], the above integral reduces as follows: 

sin(m — n)a>ot sinfm + n)u>ot Vo+Ta 

1 m ^ n 

2(777 — n)u >0 2(777 + 77)a>0 To 

t sm2ma>ot Va+Ta 

1 777 = 77 , 

2 4777070 To 

or 


/ COS(7Mft>0?) COS(7707ot)dr = 

(To) 


/ COS(777tt7of)COS(77ft7ot)dr = 

(To) 


0 777 ^ 77 

To 


(4.15) 


for 777,77 e Z + . Equation (4.15) demonstrates that the functions in the set 
{cos(t 77 &>oO, m € Z + } are mutually orthogonal. 
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Case 2 By following the procedure outlined in case 1, it is straightforward to 
show that 


/ sin(m<yoO sin(n&>o/)dr = 

(To) 


0 m ^ n 
To 


(4.16) 


for 272, 22 e Z + . Equation (4. 16) proves that the set {sin(ntt>oO, « € Z + }contains 
mutually orthogonal functions over interval 1 = [to, to + 7o] with Tq — 2tx /coq. 


Case 3 To verify that functions {cos(/72&)ot)} and {sin(rzft>ot)} are mutually 
orthogonal, consider the following: 


/ 


to+To 

cos(t? 2 tt>ot ) sin(/ 2 (Wot)dt = J cos(mcoot) sin(na>ot)dt 

to 

to+To 

1 f 

— I [sin((m + n)coot) — sin((m — ri)coot)]dt m / n 

to 

to+To 


1 f 

- I [sin(2f72c<;ot)dt 


m = 

t 0 

to+To y 

, + 2 


1 [" cos ((»2 + n)a>ot) 

COS((222 — n)wot) 

2 |_ (272 + n)too 

(222 — n)a>o 


to+To 


cos(2n&>o0 


-i to+To 


2mcoo 
0 m ^ n 
0 m — n. 


-120 


m ^ n 


m — n 


(4.17) 


for m, n e Z + , which proves that {cos(772&>of)} and {sin(n&>ot)} are orthogonal 
over interval f = [to, to + 7o] with Tq = 2tt /mq. 


Case 4 The following proof demonstrates that the function “1” is orthogonal 
to cos( 2 ? 2 &>of)} and {sin(/7&>ot)}: 


/ 1 ■ cos(ff 2 (Wof)dt = 

(To) 

-[ 


sm(mcL>ot)Vo+To 

mco 0 J/o 

sin(wa)oto + 2m7t) — sin(272&>oto) 
mtoo 


]- 


= 0 


(4.18) 


and 


/ r cos(/ 22 a>ot)n , o+ :r o 

1 • sin(/72a)ot)dt = 

L mcoo T 0 
To) 

[ cos(/? 2 (Wofo + 2nm) — cos(ma>oto)~ 

mtoo 
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for m, n e Z + . Combining Eqs. (4. 15)— (4. 19), it can be inferred that the set {1, 
cos(tt>oO> cos(2ft>of ), cos(3o>o0, • , sin(<wof), sin(2&>of ), sin(3&>oO, ■ • • } consists 

of mutually orthogonal functions. It can also be shown that this particular set is 
complete over t = [to, ?o + To] with To = 2n /&>o- In other words, there exists 
no non-trivial function outside the set which is orthogonal to all functions in 
the set over the given interval. 

Example 4.4 

Show that the set of complex exponential functions {exp(j«&)oO, n e Z} is an 
orthogonal set over any interval t = [to, to + To] with duration Tq — 2n /u>o- 
The parameter Z refers to the set of integer numbers. 

Solution 

Equation (4.10) yields 

/ exp(j«7tt>of)(exp(jw&>of))*dt 

To) 

to+To 

= J exp(j(»; — n)ma>ot)dt = 

to 

Tq m = n 

0 m ^ n. (4.20) 

Equation (4.14) shows that the set of functions {exp(jno>oO, n e Z} is indeed 
mutually orthogonal over interval f = [to, to + To] with duration To — 2 jt/wo. 
It can also be shown that this set is complete. 

Examples 4.3 and 4.4 illustrate that the sinusoidal and complex exponential 
functions form two sets of complete orthogonal functions. There are sev- 
eral other orthogonal set of functions, for example the Legendre polynomi- 
als (Problem 4.3), Chebyshev polynomials (Problem 4.4), and Haar functions 
(Problem 4.5). We are particularly interested in sinusoidal and complex expo- 
nential functions since these satisfy a special property with respect to the LTIC 
systems that is not observed for any other orthogonal set of functions. In Section 
4.3, we discuss this special property. 



Mr ° 

"exp(j(w 


n)ma>ot) 


-po+7b 


j (m — n)mcL>o 


m ^ n 


-Uo 


4.3 Fourier basis functions 


In Example 3.2, it was observed that the output response of an RLC circuit to a 
sinusoidal function was another sinusoidal function of the same frequency. The 
changes observed in the input sinusoidal function were only in its amplitude 
and phase. Below we illustrate that the property holds true for any LTIC system. 
Further, we extend the property to complex exponential signals proving that the 
output response of an LTIC system to a complex exponential function is another 
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complex exponential with the same frequency, except for possible changes in 
its amplitude and phase. 

Theorem 4.1 If a complex exponential function is applied to an LTIC system 
with a real-valued impulse response function, the output response of the system 
is identical to the complex exponential function except for changes in amplitude 
and phase. In other words, 

k ^< -> A 1 * 1 e j(<Bl,4 * l) , 
where A i and fi are constants. 

Proof 

Assume that the complex exponential function x{t) = exp( jwi f ) is applied to 
an LTIC system with impulse response hit). The output of the system is given 
by the convolution of the input signal x(t) and the impulse response h(t) is 
given by 


-/ 


y(t) = I h(x)x(t — r)dr = k\& 




LAJ 

/ 


h(r)e 


T dr. 


Defining 


OC 

-f 


H(co)= / /7(r)e _J dr, 


(4.21) 


(4.22) 


Eq. (4.21) can be expressed as follows: 

y{t) = kte^'HicoO. (4.23) 

From the definition in Eq. (4.22), we observe that H(a>\) is a complex-valued 
constant, for a given value of a>\, such that it can be expressed as // (a>\ ) = 
Ai exp(j(/>!). In other words, A \ is the magnitude of the complex constant Ilia )] ) 
and (pi is the phase of H(a> i). Expressing H{a>\) = A\ exp(j</>i) in Eq. (4.23), 
we obtain 

y(t) = A 1 £ 1 e i(<Wl, -N' l) , 

which proves Theorem 4.1. 

Corollary 4.1 The output response of an LTIC system, characterized by a real- 
valued impulse response h(t), to a sinusoidal input is another sinusoidal function 
with the same frequency, except for possible changes in its amplitude and phase. 
In other words, 


k\ sin(&>iO A i^i sin(tt>ir + <j>{) 


(4.24) 


and 


k\ cos(cuif) — >■ A\k\ cos(a>ir + fi), (4.25) 

where constants A \ and (f are the magnitude and phase of H(co i) defined in 
Eq. (4.22) with co set to <wi . 
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Proof 

The proof of Corollary 4. 1 follows the same lines as the proof of Theorem 4. 1 . 
The sinusoidal signals can be expressed as real (Re) and imaginary (Im) com- 
ponents of a complex exponential function as follows: 

cos(o)ir) = Refe^" 1 *} and sin(<uif) = Im{e^ Mlt }. 

Because the impulse response function is real- valued, the output yi(t) to k\ 
sin(o>if) is the imaginary component of y(t) given in Eq. (4.23). In other words, 

yi(r) = Im{y4i£ie- i(lUlf+ ^ l) } = A \ k\ sin(«i t + 0i). 

Likewise, the output y 2 (t) to k\ cos{co\t) is the real component of y(t) given in 
Eq. (4.23). In other words, 

y 2 (t) = Re{Ai£ie' i(a ' 1,+ ^ l) } = AiA'icos(<uif + 0i ). 


Example 4.5 

Calculate the output response if signal x(t) — 2 sin(5t) is applied as an input to 
an LTIC system with impulse response h(t) = 2 e~ 4, n(f). 


Solution 

Based on Corollary 4. 1 , we know that output y(t ) to the sinusoidal input x(t ) = 
2 sin(5r) is given by 

y(t) = 2Ai sin(5t + <pt), 


where A\ and (j)\ are the magnitude and phase of the complex constant H(oo i), 
given by 

OO OO OO 

H(o>) = J h( T)e- iaz dT = 2 j e - 4T e-j“ T dr = 2 j e- (4+j,u)T dr = 


4 + j m 


The magnitude A i and phase (j)\ are given by 


magnitude 
phase 0i 0i = <H(co\) = < 


AiAj = |//(®i)| = 
2 


4+jtu 


( 0=5 


V4d' 


( 0=5 


4+j co 

The output response of the system is, therefore, given by 

4 


= 0-tan” 1 ( - ) = -51.34°. 


y(0 = 


V41 


sin(5 1 - 51.34°). 


As shown in Example 3.4, the LTIC system with impulse response h(t) = 
2 e~ 4, u(t) can alternatively be represented by the linear, constant-coefficient 
differential equation as follows: 

dy 

-£ +Ay(t) = 2x(t). 
at 
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Fig. 4.4. Output response of an 
LTIC system, with a real-valued 
impulse response, to sinusoidal 
inputs. 


input signals 


x\(t) = 

x 2 (f) = k\ cos(ft)it) 
XT,{t) = k\ sin(<x»iO 



output signals 
x\{t) = A\k\&( (0 \ t + 0i) 

X2(i) = A\k^cos(a>A + 
xi,(t) = A\k\ sin^jf + 


Substituting x(t) = 2 sin(5f ) into this equation and solving the differential equa- 
tion, we arrive at the same value of the output y(t ) obtained using the convolution 
approach. 

Figure 4.4 illustrates Theorem 4.1 and Corollary 4.1 graphically. It may be 
noted that this property is not observed for any other input signal but only for 
the sinusoids and complex exponentials. 


4.3.1 Generalization of Theorem 4.1 

In the preceding discussion, we have restricted the input signal x(t ) to sinusoids 
or complex exponentials. In such cases. Theorem 4. 1 or Corollary 4. 1 simplifies 
the computation of the output response of a LTIC system. In cases where the 
input signal x(t) is periodic but different from a sinusoidal or complex expo- 
nential function, we follow an indirect approach. We express the input signal 
x(t) as a linear combination of complex exponentials: 

N 

x(t) = k\e2 mit + k 2 ^‘ + • • • + £ive j “ wf = Y k n s ir0nt . (4.26) 

n = 1 

Applying Theorem 4.1 to each of the N complex exponential terms in 
Eq. (4.26), the output y m (t) to the complex exponential term x m (t) = 
k m exp()a> m t ) is given by y„,(t) — A m k m exp(j co m t + <p m ). Using the principle 
of superposition, the overall output y(t) is the sum of the individual outputs and 
is expressed as follows: 

y(t) = AjA:ie j(a,1,+0l) + A 2 £ 2 e j( ' U2,-W ’ 2) H F A N k N e i( ‘° N,+ ' l ’ N) 

N 

= A„/fc,,e j( “ v+ ' w . (4.27) 

n= 1 

In the above discussion, we have illustrated the advantage of expressing a 
periodic signal x(t) as a linear combination of complex exponentials. Such a 
representation provides an alternative interpretation of the signal. This interpre- 
tation is referred to as the exponential CT Fourier series (CTFS). Alternatively, 

The Fourier series is named after Jean Baptiste Joseph Fourier (1768-1830), a French 
mathematician and physicist who initiated its development and applied it to problems of heat 
flow for the first time. 
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an arbitrary periodic signal can also be expressed as a linear combination of 
sinusoidal signals: 

OO 

x(t ) = ao + ^ (a„ cos(/?a>oO + b n sin(na>oO)- (4.28) 

72 = 1 

Corollary 4.1 can then be applied to calculate the output y(t). Expressing a 
periodic signal as a linear combination of sinusoidal signals leads to the trigono- 
metric CTFS. The trigonometric and exponential CTFS representations of CT 
periodic signals are covered in Sections 4.4 and 4.5. 


4.4 Trigonometric CTFS 

Definition 4.6 An arbitrary periodic function x(t ) with fundamental period To 
can be expressed as follows: 

OO 

x(t) — ao + ^ ( a n cos(n&>o?) + b„ sin(/7a>oO), (4.29) 

H=1 

where a>o = lit I To is the fundamental frequency ofx(t) and coefficients ao, a n , 
and b„ are referred to as the trigonometric CTFS coefficients. The coefficients 
are calculated as follows: 


--hi 

(To) 

x(t)dt, 

(4.30) 

a ’ = vj 

x(t) cos(na>ot)dt , 

(4.31) 


b n = — f x(t)sm(nco 0 t)dt. (4.32) 

lo J 

(To) 

From Eqs. (4.29)-(4.32), it is straightforward to verify that coefficient ao rep- 
resents the average or mean value (also referred to as the dc component) of 
x(t). Collectively, the cosine terms represent the even component of the zero 
mean signal (x(t) - ao). Likewise, the sine terms collectively represent the odd 
component of the zero mean signal ix(t) - ao). 

Example 4.6 

Calculate the trigonometric CTFS coefficients of the periodic signal x{t) defined 
over one period 7o = 3 as follows: 


x(t) 


; • I -1 < t < 1 
0 1 < t < 2 . 


(4.33) 
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Fig. 4.5. Sawtooth periodic 
waveform x(t) considered in 
Example 4.6. 



Solution 

The periodic signal x(t) is plotted in Fig. 4.5. Since x(t) has a fundamental 
period Tq — 3, the fundamental frequency coq = 2jt /3. Using Eq. (4.30), the dc 
CTFS coefficient «o is given by 


a ° = Y 0 J X ^ dt = \ J ^ t + 1)df = l 

( To ) -1 

The CTFS coefficients a n are given by 

l 

2 f 2 f 

in = — J x(t)cos(nw 0 t)dt = - J 


— t "1“ t 
2 


-l 


(4.34) 


a n = — / x(t)cos(na>ot)dt = - / (/ + 1) cos(n&)ot)dt 
(To) -i 

t l 

2 f 2 f 

= - / t cos(«dJoO df + - / cos(nc«of) dt. 

— 1 odd function — 1 even function 


Since the integral of odd functions within the limit [—to, to] is zero, 

1 

J t cos(«tt>of)df = 0, 


-l 


and the value of a n is given by 


1 

/ 


a n = - / cos(H&>o?)df = - I cos(na>ot)dt = - 


1 

/■ 


sin(w&>oO 
nco o 


4 sin(«&>o) 
3na>o 


Substituting &>o = 2tt/3, we obtain 


0 

n = 3k 

V3 

n ji 

V3 

n = 3k+\ 

rut 

n = 3k + 2 


(4.35) 
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for k e Z. Similarly, the CTFS coefficients b„ are given by 

1 

2 f 2 f 

b„ = — I x(t) sin(na>ot)dt = - I (t + 1) sin(H&>oOdf 


To 


{To) -1 

1 1 

2 f 2 f 

— / t sin(/70)ot)dt + - / sin(na>oOdr. 


— 1 even function 


- 1 odd function 


Since the integral of odd functions within the limits [— fo, to] is zero. 




sin(«&>o?)dt = 0, 


and the value of b n is given by 


l 


2 f 4 f 

b n = - It sin(«tt)ot)df r s * r 


-l 


1 sin(«®of)df = — J t sin(na>ot)dt 
o 


[- 


cos(na>ot ) sin(/;a)ot) 

na>o (nco 0 ) 2 


4cos(«ft>o) 4sin(«o>o) 


Jo 


Substituting coq = 2tt/3, we obtain 

2 

rut 


b„ = 


1 3V3 

rut 2(rut) 2 

1 3V3 


3na>o 

n — 3k 
n — 3k + 1 
n — 3k + 2, 


3(na>o) 2 


x(t)= ^ cos ( ^-t ) Sin l 

wL n = 1 \ ^ / n = 1 V 


( 2nn 


xav(0 


Ev{x(f)-a 0 l 


Odd{A(/)-aol 


(4.36) 


rut 2(nit) 2 

for k e Z. The periodic signal x(t) is therefore expressed as follows: 


, (4.37) 


where coefficients a n and b„ are given in Eqs. (4.35) and (4.36). Coefficient a o 
represents the average value of signal x{t), referred to as x av (t ). The cosine terms 
collectively represent the zero-mean even component of signal x(t), denoted 
by Ev{x(f) - a { ) } , while the sine terms collectively represent the zero-mean 
odd component of x(t), denoted by Odd{x(f) - ao\. Based on the values of 
the coefficients, the three components of x(t ) are plotted in Fig. 4.6. It can be 
verified easily that the sum of these three components will indeed produce the 
original signal x(t). 
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*av(0 E \{x(t) - a 0 } 



and (c) odd components for x(t) 

shown in Fig. 4.5. (c) 


4.4.1 CTFS coefficients for symmetrical signals 

If the periodic signal x(t) with angular frequency a>o exhibits some symme- 
try, then the computation of the CTFS coefficients is simplified considerably. 

Below, we list the properties of the trigonometric coefficients of the CTFS for 

symmetrical signals. 

(1) If x(t) is zero-mean, then c/q = 0. In such cases, one does not need to 
calculate the dc coefficient oq. 

(2) If x(t) is an even function, then b n = 0 for all n. In other words, an even 
signal is represented by its dc component and a linear combination of a 
cosine function of frequency ojq and its higher-order harmonics. 

(3) If .r(?) is an odd function, then «o — a n — 0 for all n. In other words, an 
odd signal can be represented by a linear combination of a sine function of 
frequency &>o and its higher-order harmonics. 

(4) If x(t) is a real function, then the trigonometric CTFS coefficients a (h a n , 
and b n are also real-valued for all n . 

(5) If g(t) = x(t) + c (where c is a constant) then the trigonometric DTFS 

coefficients {aq , a „ , bl ) of function g(t) are related to the CTFS coefficients 
{flo , , b'l 1} of x(t) as follows: 

dc coefficient cIq = a'Q + c, (4.38) 

coefficients a„ a * = a* for n = 1, 2, 3, . . . , (4.39) 

coefficients b„ b% = b* for n = 1, 2, 3, . . . (4.40) 

Application of the aforementioned properties is illustrated in the following 

examples. 
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Example 4.7 

Consider the function H’(r) = Ev{x(f) — ao} shown in Fig. 4.6(b). Express w(t) 
as a trigonometric CTFS. 


Solution 

From inspection, we see w(t) is even. Therefore, b„ = 0 for all n. Since w(t) 
is periodic with a fundamental period '/q = 3, co o = 2 tt/ 3. The area enclosed 
by one period of w(t), say t = [— 1, 2], is given by 2(1/3) + 1 ( — 2/3) = 0. 
Function wit) is, therefore, zero-mean, which imples that oq = 0. 

The value of a n is calculated as follows: 


dn 


1.5 

J w(t)cos(ncoot)dt = 

- 1.5 


4 

3 


1.5 

J w(t)cos(na>ot)dt, 
o 


which simplifies to 


dn 



1 

3 


cos(«tt>oOdf — 


4 

3 



cos(na)of)dr 


o 1 


4 

sin(na>oO 

8 

'sin(/?a>oO" 

9 

ncoo 

o 9 

ncoo 


or 


a n 


4 sin(n<yo) 
9 H&>0 

4 sin(«a;o) 
3 nco o 


8 sin(1.5nc<Jo) 

9 na>o 

8 sin(1.5nc<Jo) 

9 nco o 


8 sin(nwo) 

9 ncoo 


Substituting coq — 2tz /3, we obtain 


u n — 



leading to the CTFS representation 


w 



(4.41) 


which is same as the even component Ev{x(f) — «o} in Eq. (4.26) in 
Example 4.6. The CTFS coefficients a n are plotted in Fig. 4.7. 


From Example 4.7, we observe that a rectangular pulse train w(t) = Ev{x(t) — 
do}, as shown in Fig. 4.6(b), has a CTFS representation that includes a lin- 
ear combination of an infinite number of cosine functions. A question that 
arises is why an infinite number of cosine functions are needed. The answer 
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Fig. 4.7. DTFS coefficients a„ for the rectangular pulse in Example 4.7. 
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Fig. 4.8. Rectangular pulse reconstructed with a finite number n of 
DTFS coefficients a n . Three different values n = 5, 20, and 100 are 
considered. 
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lies in the shape of the rectangular pulse that includes two constant values 
(1/3, —2/3) separated by a discontinuity within one period. The discontinuity 
or the sharp transition in w(t ) is accounted for by a sinusoidal function with an 
infinite fundamental frequency. Generally, if a function has at least one discon- 
tinuity, the CTFS representation will contain an infinite number of sinusoidal 
functions. 

Figure 4.7 shows the exponentially decaying value of the CTFS coefficients 
a n . To obtain the precise waveform wit). an infinite number of the CTFS coef- 
ficients a n are needed. Because of the decaying magnitude of the CTFS coeffi- 
cients, however, a fairly reasonable approximation for wit) can be obtained by 
considering only a finite number of the CTFS coefficients a n . Figure 4.8 shows 
the reconstruction of w(t) obtained for three different values of n. We set n = 5, 
20, and 100. It is observed that w(t) provides a close approximation of wit) for 
n = 20. For n = 100, the approximated waveform is almost indistinguishable 
from the waveform of wit). 

4.4.2 Jump discontinuity 

Figure 4.8 shows that a CT function with a discontinuity can be approximated 
more accurately by including a larger number of CTFS coefficients. When 
approximating CT periodic functions with a finite number of CTFS coefficients, 
two errors arise because of the discontinuity. First, several ripples are observed 
in the approximated function. A careful observation of Fig. 4.8 reveals that, as 
more terms are added to the CTFS, the separation between the ripples becomes 
narrower and the approximated function is closer to the original function. The 
peak magnitude of the ripples, however, does not decrease with more CTFS 
terms. The presence of ripples near the discontinuity (i.e. around t = ±1 in 
Fig. 4.8) is a limitation of the CTFS representation of discontinuous signals, 
and is known as the Gibbs phenomenon. 

Secondly, an approximation error is observed at the location of the disconti- 
nuity (i.e. at t — ±1 in Fig. 4.8). With a finite number of terms, it is impossible 
to reconstruct precisely the edge of a discontinuity. However, it is possible to 
calculate the value of the approximated function at the discontinuity. Suppose 
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Fig. 4.9. Magnified sketch of Fig. 4.8 at f = 1 . 
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Fig. 4.10. CT periodic signal g(t) with fundamental period T 0 = 2 n 
considered in Example 4.8. 


x(t) has a jump discontinuity at t = t\. The reconstructed value for x(t } ) is 
given by 

x(t ] )= l -[x{t ] +) + x(ti-)]. (4.42) 


For example, the reconstructed value of w{t) in Fig. 4.8 at t = 1 is given by 


w(l)= ^ [w(l-) + w(l+)] 


2 

3 


1 

6 ' 


Figure 4.9 is an enlargement of part of Fig. 4.8 at t — 1, where it is observed 
that the reconstructed signals have a value of — 1 /6 at t = 1 . 


Example 4.8 

Consider the periodic signal g(t) shown in Fig. 4.10. Calculate the CTFS 
coefficients. 


Solution 

Because Tq — 2tt, the fundamental frequency coq = 1. The dc coefficient uq is 
given by 


2n 


“°=tJ guyk = b / 3<r " 


dr = — 
2jt 


(To) 

15 

= — [1 — e 
2n 


a -0.2 1 


- 0.2 


2n 


—OAtt n 


1.7079. 


The CTFS coefficients a n are given by 


-k! 


2 TT 


= — f 

2jt J 


a„ = — j g(t) cos(na>ot)dt = — / 3e °' 2 ' cos(«r)dr 


(To) 

3 1 


or 


2 it n 2 + 0.2 2 

3 1 


[e _0 ' 2, {— 0.2 cos(nt) + n sinOtf)}]^ 


2 Tt n 2 + 0.2 2 
[i _ e -°- 47r 

(n 2 + 0.2 2 )7 r 


[— 0.2e^°' 47r + 0.2] 

3.4157 


1 + 25n 2 ’ 
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Fig. 4.11. Periodic signal f(t) 
considered in Example 4.9. 


m 



Similarly, the CTFS coefficients b n are given by 


kJ 


2 TC 


— f : 

2jt J 


b n = — I g(t) sin(«a>oOd ? = — / 3e °' 2 ' sin(«f)dr 


(To) 

3 1 

2tt n 2 + 0.2 2 


[e °' 2 '{— 0.2 sin(nt) — «cos(nf)}]o 


2 7T 


b n — 


1 


;[—ne 


-0.4jt 


3 n 


[1 — e-° 4jr ] 


17.0787/? 


2?r n 2 + 0.2 2 (n 2 + 0.2 2 Y 1 + 25/? 2 ' 

The trigonometric CTFS representation of g(t) is therefore given by 

3.4157 ^ 17.0787 


X — > I/. 0/0/ 

Y+25i? COS<n,) + ^ TT2S?" ” 

n= l n = 1 


sin(nf)- 


Example 4.9 

Consider the periodic signal f(t) as shown in Fig. 4.11. Calculate the CTFS 
coefficients. 


Solution 

Because 7o = 4, the fundamental frequency o>o = tt/ 2. Since f(t) is zero-mean, 
the dc coefficient oq = 0. Also, since f(t) is an even function, b n = 0 for all /?. 
The CTFS coefficients a n are given by 


2 2 

a„ = — j f(t)cos(na>ot)dt = - J (3 — 3t) cos(/?tt>ot)dr 


-\L 


—2 even function 

sin(/7&>oO 


0 


= (3 - 30 - 


na> 0 


^COS(/7ft)o ? ) 

(moo) 2 
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Substituting a > o = jt/2, we obtain 


sinfnjr) cos(«7r) 1 

(-3)— i — - - 3 _ .1 + 3- 


0.5njr (0.5/?7 t) 2 (0.5n:r) 2 


= 3 


1 


(-D" 

(0.5/77T) 2 (0.5«7r) 2 


12 

inn)- 


[1 — (— 1 )”] 


0 /7 is even 

24 

n is odd. 


(fljr)- 


The CTFS representation of /(?) is given by 
24 


m= E 

n=l,3,5, ••• 

_ 24 
“ 72 


inn)- 


■ cos(0.5n7r?) 


7T Z 


1 1 

cos(0.57r?) + - cos(1.57T?) + — cos(2.5ir?) + 


Example 4.10 

Calculate the CTFS coefficients for the following signal: 

xit) = 3 + cos ^4? + — ^ + sin ^ 10? + , : ■ 


Solution 

The fundamental period of cos(4? + 7r/4) is given by T\ = n /2, while the 
fundamental period of sin( 10? + n/3) is given by T 2 = n/5. Since the ratio 

T\ = 5 
T 2 2 

is a rational number. Proposition 1.2 states that xit) is periodic with a fun- 
damental period of n. The fundamental frequency coq is therefore given by 
coo = 2n /Tq = 2. 

Since xit) is a linear combination of sinusoidal functions, the CTFS coef- 
ficients can be calculated directly by expanding the sine and cosine terms as 
follows: 


xit) = 3 + cos(4?)cos — sin(4?)sin + sin(10?)cos 
+ cos(10r) sin . 

Substituting the values of sin(7r/4), cos(:r/4), sin(:r/3), and cos(jt/3), we obtain 

1 1 1 V3 

xit) = 3-1 — — cos(4?) — sin(4?) + - sin(10?) H cos(10r). 

v 2 V2 2 2 
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Comparing the above equation with the CTFS expansion, 

OO 

x(t ) = ao + ^ ( a n cos(ncoot ) + b„ sin(«&>oOX 

n= 1 


with coo = 2, we obtain 


a o = 3, «2 


1 V3 , 1 

\[2 ~ 2 ’ 2 ~ V 2 ’ 


and /?5 


1 

2 ' 


The CTFS coefficients a„ and b n , for values of n other than n = 0, 2, and 5, are 
all zeros. 


Example 4.11 

A periodic signal is represented by the following CTFS: 

2 OO j 

x(t ) = — y sin(47r(2»7 + l)f). 

jt ' 2m + 1 
m—0 

(i) From the CTFS representation, determine the fundamental period Tq of 
x(t). 

(ii) Comment on the symmetry properties of x(t). 

(iii) Plot the function to verify if your answers to (i) and (ii) are correct. 

Solution 

(i) The CTFS representation is obtained by expanding the summation as follows: 

2 OO j 

x(t) = — y sin(47r(2m + l)r) 

7 r z — i 2m + 1 

m—0 

2 r i i i 

= — sin(47rf) H — sin(127rr) H — sin(20jrt) H — sin(28jrf) + ■ ■ • . 

7r [ 3 5 7 

Note that the signal x(t ) contains the fundamental component sin(4jrt) and its 

higher-order harmonics. Hence, the fundamental frequency is a>o = 47T with 
the fundamental period given by Tq = 2n /An = 1 /2. 

(ii) Because the CTFS contains only sine terms, x(t) must be odd based on 
property (3) on page 156. 

(iii) It is generally difficult to evaluate the function x(t) manually. We use a 
M A T L A B function i c t f s . m (provided in the accompanying CD) to calculate 
x(t). The function, reconstructed using the first 1000 CTFS coefficients, is plot- 
ted in Fig. 4.12 for — 1 < t < 1 . It is observed that the function is a rectangular 
pulse train with a fundamental period of 0.5. It is also observed that the function 
is odd. 
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Fig. 4.12. Waveform 
reconstructed from the first 1000 
CTFS coefficients in Example 
4.11. 



4.5 Exponential Fourier series 


In Section 4.4, we considered the trigonometric CTFS expansion using a set 
of sinusoidal terms as the basis functions. An alternative expression for the 
CTFS is obtained if complex exponentials {exp(j«<wof)}, for n e Z, are used 
as the basis functions to expand a CT periodic signal. The resulting CTFS 
representation is referred to as the exponential CTFS, which is defined below. 


Definition 4.7 An arbitrary periodic function x(t ) with a fundamental period 
T 0 can be expressed as follows: 

OO 

x{t) = D„e> naot , (4.43) 

m= 0 

where the exponential CTFS coefficients D n are calculated as 

D„ = — f x(t)e~ inm, dt, (4.44) 

To J 

(To) 

u> o being the fundamental frequency given by coo — 2 tt/Tq. 

Equation (4.43) is known as the exponential CTFS representation of x(t). Since 
the basis functions corresponding to the trigonometric and exponential CTFS 
are related by Euler’s identity, 

e — j«cu 0 c _ cos ( w<Wo f) _ j sin(nft>oO, 


it is intuitively pleasing to believe that the exponential and trigonometric CTFS 
coefficients are also related to each other. The exact relationship is derived by 
expanding the trigonometric CTFS series as follows: 


OO 

x{t) = a 0 + ^ (fl„ cos(n®oO + b n sin (nw 0 O) 

n—l 


= a o 


n=l 


E> J 


= J noi 0 t 


e -j niDQt^ _j_ _f( e ina> 0 t _ g-jnaiof-j 

n = 1 2 J 


Combining terms with the same exponential functions, we obtain 

j OO j OO 

x(t) = ao + 2 E ( a '• ~ J b n )z ]nmt + 2 E ( ' a " + J b„)e~ inaot . 

n= 1 / 7 = 1 
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The second summation can be expressed as follows: 

OO —1 

+ }b l ,)s~ ,na, ° r = (fl- n + )b- n )e in<O0t , 

n = 1 n——oo 

which leads to the following expression: 



Comparing the above expansion with the definition of exponential CTFS, 
Eq. (4.31), yields 



ao 


n 

= 0 


1 




D n = 

2 (a " 

“j b n ) 

n 

> 0 


1 






? + j b- n ) 

n 

< 0 


(4.45) 


Example 4.12 

Calculate the exponential CTFS coefficients for the periodic function g (t ) shown 
in Fig. 4.10. 


Solution 

By inspection, the fundamental period Tq = 2it, which gives the fundamental 
frequency coq = 2tt /2tc = 1. The exponential CTFS coefficients D n are given 
by 

2 n 2 7t 

D„ = — [ g(t)e~ inm °‘ dt = — [ 2>er 0 ' 2 ' eT inu>0 ' dt = — f e ~^ 2 +^o) 'dr 
T 0 J 2n J 2 n J 

(T 0 ) 0 0 


or 


D 


n 


3 Q-(0.2+]n(Do)t 

2: x _(0.2+jna)o) 


-j 2 tt 

- 0 


3 1 

27r (0.2 + jncwo) 


[1 


e -(0.2+j«mo)2jr 


]■ 


Substituting co o = 1, we obtain the following expression for the exponential 
CTFS coefficients: 


D„ = 




-(0.2+j«)27r"| 


27r(0.2 + j«) 

1 [l-e-°- 4 *]~ 03416 . 

27r(0.2+jn) L (0.2 +j«) 


(4.46) 


Example 4.13 

Calculate the exponential CTFS coefficients for f(t) as shown in Fig. 4.1 1. 
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Solution 

Since the fundamental period To = 4, the angular frequency a>o = 2 tt/4 = n /2. 
The exponential CTFS coefficients D„ are calculated directly from the definition 
as follows: 

2 

D„ = y J /(r)e-j" M °'dr = l - j f(t)e~^'dt 

(To) -2 

2 2 

f(t ) sin(«&>oOdf- 

—2 even function —2 odd function 

Since the integration of an odd function within the limits [to, —to] is zero, 

2 2 

D n = - J f(t) cos(«ft>of)df = - J (3 — 3t)cos(«&>of)df, 

-2 0 


which simplifies to 


D„ = - 
2 

_ 3 
~ 2 


(3 - 3t) 


sin(ntt>o0 - cos(«<wq0 


«« 0 (na>o ) 2 

sin(2n«o) cos(2«&)o) 


ncoQ 


Substituting coq = n /2, we obtain 

sin(njro) cos(«7r) 


3 

= - 
2 


0&>o) 2 


1 


(«« o) 2 


0.5nit (0.5/27T ) 2 (0.5«7r) 2 


(rm) 


[1 - (- 1 )"] 


or 




0 

12 

(rm) 2 


n is even 
n is odd. 


(4.47) 


In Examples 4.11 and 4.12, the exponential CTFS coefficients can also be 
derived from the trigonometric CTFS coefficients calculated in Examples 4.7 
and 4.8 using Eq. (4.45). 


Example 4.14 

Calculate the exponential Fourier series of the signal x(t) shown in Fig. 4.13. 


Solution 

The fundamental period Tq = T , and therefore the angular frequency coq = 
2: t/T . The exponential CTFS coefficients are given by 

r/2 r/2 

D„ = T J x(t)e-i nm 'dt = - I 1 . e~i na> 0 'dt. 

-r/2 -r/2 
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Fig. 4.13. Periodic signal x(t) for 
Example 4.14. 


x(t) 


-T 


T _t t T 
"2 2 2 2 


► t 


From integral calculus, we know that 


J e- jn “°'d t = 


e -j no> 0 t+c 

j«O>0 

t + C 


n^O 

n — 0. 


We consider the two cases separately. 


(4.48) 


Case I For n — 0, the exponential CTFS coefficients are given by 


D 


n 


l 

T 




r/2 

-r/2 


r 

T' 


Case II For n ^ 0, the exponential CTFS coefficients are given by 


D 


n 


j nco 0 T 


[e-jmuoi]^ 



or 


D 


n — 




In the above derivation, the CTFS coefficients are computed separately for 
n — 0 and n ^ 0. However, on applying the limit n —> 0 to the D n in case II, 
we obtain 

r /«r\ r / «r\ r 

lim D„ = lim —sine — ) = — lim sine I — = — 

/?— »o «^o T V T ) T «— >o V T ) T 


lim sinc(wj.r) = 1 

x ->0 


In other words, the value of D n for n — 0 is covered by the value of D n for n / 0. 
Therefore, combining the two cases, the CTFS coefficient for the function x(t) 
is expressed as follows: 


D 


n — 




(4.49) 


for — oo < n < oo. As a special case, we set r = 7t/2 and T — 2jt. The result- 
ing waveform for x(t) is shown in Fig. 4.14(a). The CTFS coefficients for the 
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(a) 

























v , 

• 



V.X. 



**• 





•<** 



-20 -15 -10 -5 0 5 10 15 20 

(b) 


Fig. 4.14. Exponential CTFS 
coefficients for the signal x(t ) 
shown in Fig. 4.13 with r = w/2 
and T = It:, (a) Waveform for 
x(t). (b) Exponential CTFS 
coefficients. 


special case are given by 

1 /n\ 

Dn = 4. s |nc (4 J ’ 

for —00 < n < 00 . The CTFS coefficients are plotted in Fig. 4.14(b). 

As a side note to our discussion on exponential CTFS, we make the following 
observations. 


(i) The exponential CTFS provide a more compact representation compared 
with the trigonometric CTFS. However, the exponential CTFS coefficients 
are generally complex- valued. 

(ii) For real-valued functions, the coefficients D„ and Z)_„ are complex conju- 
gates of each other. This is easily verified from Eq. (4.45) and the symmetry 
property (4) described in Section 4.4. 


4.5.1 Fourier spectrum 

The exponential CTFS coefficients provide frequency information about the 
content of a signal. However, it is difficult to understand the nature of the signal 
by looking at the values of the coefficients, which are generally complex- valued. 
Instead, the exponential CTFS coefficients are generally plotted in terms of 
their magnitude and phase. The plot of the magnitude of the exponential CTFS 
coefficients \D n \ versus n (or nco 0 ) is known as the magnitude (or amplitude) 
spectrum, while the plot of the phase of the exponential CTFS < D n versus n 
(or nco 0 ) is referred to as the phase spectrum. 

Example 4.15 

Plot the magnitude and phase spectra of the signal g(t) considered in 
Example 4.12. 

Solution 

From Example 4.1 1, we know that the exponential CTFS coefficients are given 
by 

0.3416 
0.2 + jn 


A 
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Table 4.1. Magnitude and phase of D n for a few values of n given in Example 4.15 


n 0 ±1 ±2 ±3 ±4 ... ±00 

| £>„ I 1-7080 0.3350 0.1700 0.1136 0.0853 ... 0 

<D„ 0 =p0.43727r ^0.4683^ ^0.47887r :p0.4841jr ... ^0.57r 



0 . 5 k 
0.25 k 
0 

- 0.25 n 
- 0.5 k 







































































-10 -8 -6 -4 -2 


10 


(a) 


(b) 


Fig. 4.15. CTFS coefficients of 
signal g(t) shown in Fig. 4.10. 

(a) Magnitude spectrum. 

(b) Phase spectrum. 


The magnitude and phase of the exponential CTFS coefficients are as follows: 


magnitude 

phase 


0.3416 0.3416 

" ~ 1(0.2 + j«) | “ 7(1.04 + n2 ; 

<D n =<3.416— <(0.2+j/?) = — tan _1 (5«). 


Table 4. 1 shows the magnitude and phase of D n for a few selected values of n. 
The phase values are expressed in radians. The magnitude and phase spectra 
are plotted in Fig. 4.15. 

The magnitude of the exponential CTFS coefficients D n indicates the strength 
of the frequency component nu > o (i.e. the nth harmonic) in the signal x(t). The 
phase of D„ provides additional information on how different harmonics should 
be shifted and added to reconstruct x(t). 


Example 4.16 

Calculate and plot the amplitude and phase spectra of signal x(t) considered in 
Example 4.14 for r = n/2 and T = 2jt. 

Solution 

The exponential DTFS coefficients are given by 


Substituting r = tc/2 and T = 2n, we obtain 

1 /n\ 

D ” = 4 smc V 4 / ’ 

which are plotted in Fig. 4.14. Note that the coefficients are all real-valued 
but periodically vary between positive and negative values. Because the CTFS 
coefficients D n do not have imaginary components, the phase corresponding to 
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(a) 


(b) 


Fig. 4.16. (a) The amplitude and 
(b) the phase spectra of the 
function shown in Fig. 4.14 (see 
Example 4.14). The phase 
spectra are given in radians/s. 


the CTFS coefficients is calculated from its sign as follows: 

if D„ > 0, then the associated phase <D n = 0; 

if D„ < 0, then the associated phase <D n = jc or —n. 

The magnitude and phase spectra are plotted in Fig. 4.16. In Fig. 4.16(a), 
we observe that the magnitude spectrum is always positive, while the phase 
spectrum toggles between the values of 0 and i r radians/s. Note that the phase 
plot is not unique since the phase of tt is equivalent to the value of — n. 


4.6 Properties of exponential CTFS 


The exponential CTFS has several interesting properties that are useful in 
the analysis of CT signals. We list the important properties in the following 
discussion. 

Symmetry property For real-valued periodic signals, the exponential CTFS 
coefficients D n and Z)_„ are complex conjugates of each other. 

Proof 

Recall that the exponential CTFS coefficients are related to the trigonometric 
CTFS coefficients by Eq. (4.45), given below 

1 

D n =-{a n -]bn) for n > 0 

and 

1 

D-„ = ~(a n + j b n ) for n > 0. 

For real-valued functions, property (4) of the symmetric functions in 
Section 4.4. 1 states that the trigonometric Fourier coefficients a n and b n are 
always real. Based on the aforementioned equations, the exponential CTFS 
coefficients D n and D_ n are therefore complex conjugates of each other. 

As a corollary to this property, consider the magnitude and phase of the expo- 
nential CTFS coefficients: 



(4.50) 
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and 

<D_„ = -<D n = tan”' , (4.51) 

which illustrate that the magnitude spectrum is an even function and that the 
phase spectrum is an odd function. Consider the magnitude and phase spectra 
of the function g(t) in Example 4.11. The spectra are shown in Fig. 4.15. It 
is observed that the amplitude spectrum is even, whereas the phase spectrum 
is odd, which is expected as the function g(t) is real. Consider the rectangular 
pulse train in Example 4.16, whose amplitude and phase spectra are shown 
in Fig. 4.16. The amplitude function is again observed to be even symmetric. 
However, the phase spectrum does not seem to be odd, although the time-domain 
function is real- valued. Actually, the angle 7t'' (i.e. 180°) is equivalent to —n r 
(i.e. —180°); the phase values it r can be changed appropriately to satisfy the 
odd property. 


Parseval’s theorem The power of a periodic signal x(t) can be calculated from 
its exponential CTFS coefficients as follows (see Problem 1.9 in Chapter 1): 


If 00 

P, = ~ / \x(t)\ 2 dt = T I D„ 

(To) 


(4.52) 


For real- valued signals, \ D n \ = | £)_„ | , which results in the following simplified 
formula: 

OO OO 

P,= \D n \ 2 =\D 0 \ 2 + 2j2\Dn\ 2 - (4-53) 

n = — oo n = 1 


Example 4.17 

Calculate the power of the periodic signal f(t) shown in Fig. 4.11. 


Solution 

It was shown in Example 4.13 that the exponential CTFS coefficients of the 
signal /(f) are given by 


D 


n 


o 

12 

(njt) 2 


n is even 
n is odd. 


Since f(t) is real-valued, using Parseval’s theorem (Eq. (4.53)) yields 


Pf=Y J \D„\ 2 = |A)| 2 + 2]T|D„| 2 = 2 


n=0 


n=l,3,5, 


12 


288 ^ 1 288 

= — r V — = — x 1.015 = 3. 

7T 4 » 4 

72 = 1,3,5,... 


(4.54) 
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The above value of Pf can also be verified by calculating the power directly in 
the time domain: 


-rj 

(7 


z 

-?/' 


Pf = I df =7 / (3 

To) 

'-27 27' 


3f) dr = - 
2 


'(3-3 r) 3 
-9 


o 


= 3. 


Jo 


(4.55) 


Linearity property The exponential CTFS coefficients of a linear combination 
of two periodic signals X\ (t) and X2 (t), both having the same fundamental 
period To, are given by the same linear combination of the exponential CTFS 
coefficients for X\(t) and (t). Mathematically, this implies the following: 

CTFS CTFS 

ifxi(r) ■* > D n and X 2 (r) < > E n then 

CTFS 

aiXi(t) + a 2 x 2 {t) < > a x D n + a 2 E„, (4.56) 

with the linearly combined signal a\X\{t) + 02*2(0 having a fundamental 
period of Tq. 

A direct application of the linearity property is the periodic signal that is a 
magnitude- scaled version of the original periodic signal x(t). The exponential 
CTFS coefficients of the magnitude-scaled signal are given by the following 
relationship: 

PTFS CTFS 

ifx(r) < * D n then ax(t) < » aD, (4-57) 


Time-shifting property If a periodic signal x(t) is time-shifted, the ampli- 
tude spectrum remains unchanged. The phase spectrum changes by an expo- 
nential phase shift. Mathematically, the time-shifting property is expressed as 
follows: 

CTFS CTFS — \ncQc\tc) /a co \ 

if x(t) < * D n then x(t — to) < » D„ e > (4.58) 

where x(t — to) represents the time-shifted signal obtained by shifting x(t) 
towards the right-hand side by to . The proof of the time-shifting property follows 
directly by calculating the exponential CTFS representation for the time-shifted 
signal x(t — to) from the definition. 

Example 4.18 

Calculate the exponential CTFS coefficients of the periodic signal s(t) shown 
in Fig. 4.17. 


Solution 

Comparing the waveform for s(t) in Fig. 4.17 with the waveform for x(t) in 
Fig. 4.14, we observe that 


s(t) = x(t — jt /4). 
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Fig. 4.17. Periodic signal s(t) for 
Example 4.18. 



The two waveforms s(t) and x(t) have the same time period T t) = 2n, which 

gives a>o = 1. Based on the time-shifting property, we obtain 

/ 7 T \ ctfs . 

s(t) = x (t - -J < » D n e~ lnjv/4 , 

where D n denotes the exponential CTFS coefficients of x(t). Using the value 
of D n from Example 4.14, the CTFS coefficients S n for s(t) are given by 

Sn = ^ sinc t^) e " J,,,r/4 ’ 

for — oo < n < oo. From the above expression, it is clear that the magnitude 
|S„ | = \D n \, but that the phase of S„ changes by an additive factor of —rut /4. 

Time reversal If a periodic signal x(t) is time-reversed, the amplitude spectrum 
remains unchanged. The phase spectrum changes by an exponential phase shift. 
Mathematically, 

if x(t) < > D n then x(—t) < > D_ n > (4.59) 

which implies that if a signal is time-reversed, the CTFS coefficients of a time- 
reversed signal are the time-reversed CTFS coefficients of the original signal. 

Example 4.19 

Calculate the exponential CTFS coefficients of the periodic signal p(t) shown 
in Fig. 4.18. Represent the function as a CTFS. 

Solution 

From Fig. 4.18, it is observed that p(t) is a time-reversed version of s(t) plotted 
in Fig. 4.17. Therefore, the exponential CTFS coefficients can be obtained by 


Fig. 4.18. The periodic signal 
p(t) in Example 4.19. 



i 

1 W ' 


• • • 






• • • 


-7>n -2k -k 0 k 2k 
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Fig. 4.19. Periodic signal r(t) for 
Example 4.20 obtained by 
time-scaling Fig. 4.14. 


applying the time-reversal property to the answer in Example 4.18. Using the 
latter approach, the CTFS coefficients P n for p(t) are given by 

P n = S-„ = sine e - j( -" )7r/4 = 1 sine Q) e j,nr/4 . (4.60) 


Equation (4.60) can also be obtained directly by applying the time-shifting 
property (to — —tt/ 2 ) to the waveform in Fig. 4.14(a) in Example 4.14. 

The function p(t ) can now be represented as an exponential CTFS as follows: 


OO 

P (t)= y p ^ ina,ot 

n = — oo 


1 OO 

5 E K?) 


gj«rr/4 e j nt 


1 

4 


t Hd 


e j«(r+jr/4) 


where the fundamental frequency a>o is set to 1 . 


Time scaling If a periodic signal x(t) with period Tq is time-scaled, the CTFS 
spectra are inversely time-scaled. Mathematically, 

CTFS / t \ CTFS 

if x(t) < > D n then — j 4 > Dan , (4.61) 

where the time period of the time-scaled signal x(t /a) is given by (To/ a). 

Example 4.20 

Calculate the exponential CTFS coefficients of the periodic function r(t ) shown 
in Fig. 4.19. Represent the function as a CTFS. 


Solution 

From Fig. 4.19, it is observed that r(t ) (with Tq — jt) is a time-scaled version 
of x(t ) (with Tq = 2 i r) plotted in Fig. 4.14. The relationship between r(t) and 
x(t ) is given by 


r(t) = 2 x( 2 1 ). 

Using the time-scaling and linearity properties, 

CTFS CTFS 

if x(t) < » D n then 2 x( 2 t) < » 2 D n/2 . ( 4 - 62 ) 


r(i) 


->/ 


n 
' 2 


K 

2 
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Using the results obtained in Example 4.14, the CTFS coefficients R n of r(t) 
are given by 

1 ( nt 2\ 1 / n\ 

R n = 2- sine! — j = - smc(-J , (4.63) 

for — oo < n < oo. The function r(t) can now be represented as an exponential 
CTFS as follows: 

OO « OO 

x(t)= £ R„^°‘ = - £ sinc(-)e^ 2 ' I? , 

n =— oo n=—o o 

where the fundamental frequency coo is set to 2. 


Differentiation and integration The exponential CTFS coefficients of the 
time-differentiated and time-integrated signal are expressed in terms of the 
exponential CTFS coefficients of the original signal as follows: 

CTFS dx CTFS f CTFS D„ 

if x(t) < >- D, , then — < >jncooD„ and / x(t)dt < > ; . 

dr J }nw 0 

To 

(4.64) 


It may be noted that the signal obtained by differentiating or integrating a 
periodic signal x(t) over one period Tq has the same period Tq as that of the 
original signal. 


Example 4.21 

Calculate the exponential CTFS coefficients of the periodic signal g(t) shown 
in Fig. 4.20. 


Solution 

The function g(t ) can be obtained by differentiating x(t) shown in Fig. 4.14. 
Therefore, the CTFS coefficients G„ can be expressed in terms of the CTFS 
coefficients D n as follows: 

G„ = jna>oD n with ®o = 1. 

Substituting the value of 



Fig. 4.20. Periodic signal g(t ) 
for Example 4.21. 
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yields 

1 ni\ j n /n\ 

G„ = 0«) 4 sinc(-j = -sinc(-j. 

The function r(t) can now be represented as an exponential CTFS as follows: 

OO | OO 

r(t)= G„e J "“ of = - (j«)sinc(^)e J "', 

n — — oo n=—oo 

where the fundamental frequency a>o is set to 1 . 


4.6.1 CTFS with different periods 

In this section, we consider the variation of the CTFS when the period of a 
function is changed. We use the rectangular pulse train for simplicity as its 
CTFS coefficients are real-valued. 

Example 4.22 

Consider the periodic function x(t ) in Fig. 4.13 (in Example 4.14) for the 
following three cases: 

(a) r = 1 ms and T = 5 ms; 

(b) r = 1 ms and T = 10 ms; 

(c) r = 1 ms and T = 20 ms. 

In each of the above cases, (i) determine the fundamental frequency, (ii) plot 
the CTFS coefficients, and (iii) determine the higher-order harmonics absent in 
the function. 

Solution 

It was shown in Example 4.14 that the exponential DTFS coefficients are given 
by 



(a) With T = 5 ms, the fundamental frequency is f 0 = l/T = 1/5 ms = 
200 Hz, while the fundamental angular frequency is a > o = 2nfo = 4007T 
radians/s. The corresponding exponential CTFS coefficients are given by 



which are plotted in Fig. 4.21(a) using two scales on the horizontal axis. The 
first scale represents the number n of the CTFS coefficients and the second scale 
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Fig. 4.21. CTFS coefficients for 
square waves with different duty 
cycles, (a) r = 1 ms; T =5 ms. 

(b) r = 1 ms; T = 10 ms; 

(c) r = 1 ms; T = 20 ms. 



represents the corresponding frequency / = nfo in hertz. The CTFS coefficient 
for n — 0 (or / = 0 Hz) has a value of 0.2, which is the strength of the dc 
component in the function. The spectrum at n = 1 (or / = 200 Hz) has a value 
of 0.19, which is the strength of the fundamental frequency (corresponding to 
200 Hz, or 400 tt radians/s) in the function. The spectrum at n = 2 has a value 
of 0. 1 5, which is the strength of the first harmonic corresponding to a frequency 
/ of 400 Hz, or angular frequency coq of 800 jt radians/s in the function. 

From Fig. 4.21(a), we observe that the CTFS coefficients D n are zero 
at n = ±5, ±10, ±15, . . . , which correspond to frequencies ±1000 Hz, 
±2000 Hz, ±3000 Hz, . . . (i.e. nfo), respectively. In other words, the miss- 
ing harmonics will correspond to frequencies ±1000 Hz, ±2000 Hz, 
±3000 Hz, ... or m x 10 3 Hz, where m is a non-zero integer. 

(b) With T set to 10 ms, the fundamental frequency / 0 = 1 /T = 1/10 ms = 
100 Hz, while the fundamental angular frequency is given by a>o = 2tt/o = 
2007 r radians/s. The exponential CTFS coefficients are now given by 



which are plotted in Fig. 4.21(b). The CTFS coefficient for n = 0 has a value of 
0.1. With T = 10 ms, the harmonics corresponding to n = ±10, ±20, ±30, . . . 
are all equal to zero. Interestingly, the missing harmonics correspond to fre- 
quencies / = nfo, which are given by ±1000, ±2000, ±3000, . . . Hz, have the 
same values as the frequency components missing in part (a). 

(c) With T set to 20 ms, the new fundamental frequency fo= 1 /'/' = 
1 /20 ms = 50 Hz, while the fundamental angular frequency is given by 


177 


4 Signal representation using Fourier series 


u > o = 2jr/o = 1007T radians/s. The exponential CTFS coefficients are now 
given by 



which are plotted in Fig. 4.21(c). The CTFS coefficient for n — 0 has 
a value of 0.05. With T — 20 ms, the harmonics corresponding to n = 
±20, ±40, ±60, . . . are all equal to zero. As was the case in parts (a) and (b), 
the missing harmonics correspond to frequencies / of ±1000, ±2000, 
±3000, ... Hz. 

For a square wave, the ratio x/T is referred to as the duty cycle, which is 
defined as the ratio between the time r that the waveform has a high value 
and the fundamental period T . Cases (a)-(c) are illustrated in Figs. 4.21(a)-(c), 
where the duty cycle was reduced by keeping r constant and increasing the value 
of the fundamental period T. Alternatively, the duty cycle may be decreased 
by reducing the value of r, while maintaining the fundamental period Tata 
constant value. By changing the duty cycle, we observe the following variations 
in the exponential DTFS representation. 

DC coefficient Since the dc coefficient represents the average value of the 
waveform, the value of the dc coefficient T>o decreases as the duty cycle (x/T) 
of the square wave is reduced. 

Zero crossings As the duty cycle (x/T) is decreased, the energy within one 
period of the waveform in the time domain is concentrated over a relatively 
narrower fraction of the time period. Based on the time-scaling property, the 
energy in the corresponding CTFS representations is distributed over a larger 
number of the CTFS coefficients. In other words, the width of the main lobe 
and side lobes of the discrete sine function increases with a reduction in the 
duty cycle. 

4.7 Existence of Fourier series 


In Sections 4.4 and 4.5, the trigonometric and exponential CTFS representations 
of a periodic signal were covered. Because the CTFS coefficients are calculated 
by integration, there is a possibility that the integral may result in an infinite 
value. In this case, we state that the CTFS representation does not exist. Below 
we list the conditions for the existence of the CTFS representation. 

Definition 4.8 The CTFS representation (trigonometric or exponential) of a 
periodic function x(t) exists if all CTFS coefficients are finite and the series 
converges for all n. In other words, there is no infinite value in the magnitude 
spectrum of the CTFS representation. 

For the CTFS representation to exist, the periodic signal x(t) must satisfy the 
following three conditions. 
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(1) Absolutely integrable. The area under one period of |jc(f)| is finite, i.e. 

J |x(0|df < oo. (4.65) 

To 

(2) Bounded variation. The periodic signal x (t) has a finite number of maxima 
or minima in one period. 

(3) Finite discontinuities. The period x{t) has a finite number of discontinuities 
in one period. In addition, each of the discontinuity has a finite value. 

The above conditions are known as the Dirichlet conditions . ' If these condi- 
tions are satisfied, it is guaranteed that perfect reconstruction is obtained from 
the CTFS coefficients except at a few isolated points where the function x(t) 
is discontinuous. The first condition is also known as the weak Dirichlet con- 
dition, whereas the second and third conditions are known as strong Dirichlet 
conditions. Most practical signals satisfy these three conditions. Examples of 
the CT functions that violate these conditions are included in the following 
discussion. 


Example 4.23 

Determine whether the following functions satisfy the Dirichlet conditions: 


(i) h{t) = tan(7rr); 

(ii) g(r) = sin(0.57r/f) for 0 < t < 1 and g(t) = g(t + 1); 
1 2 _2m_1 < t < 2~ 2m 

0 2~ 2m ~ 2 < t < 2 -2 '" -1 

for m e Z + , 0 < t < 1, and x(t) = x(t + 1). 


(iii) x(t) = 


(4.66) 

(4.67) 

(4.68) 


Solution 

(i) The CT function h{t) is plotted in Fig. 4.22(a). We now proceed to determine 
if h(t ) satisfies the Dirichlet conditions. Condition (1) is violated because 

0.5 

/ w0|d ' = / tan(7r?)df = oo. 

T 0 - 0.5 

This is also apparent from the waveform of tan(7rr), plotted in Fig. 4.22(a), 
where the waveform approaches ±oo at each discontinuity. Condition (2) is 
satisfied as there are only one maximum and one minimum within a single 
period of h{t). Condition (3) is violated. Although there is only one discontinuity 
within a single period of h{t), the magnitude of the discontinuity is infinite. 

(ii) The CT function g{t) is plotted in Fig. 4.22(b). Condition (1) is sat- 
isfied as the area enclosed by |g(f)| is finite. Condition (2) is violated as an 


t These conditions were derived by Johann Peter Gustav Lejeune Dirichlet (1805-1859), a 
German mathematician. 
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(a) 


Fig. 4.22. Functions (a) h(t), 

(b) g(t), and (c) x(t) in Example 
4.23. These functions violate one 
or more of the Dirichlet 
conditions, and therefore the 
CTFS representation does not 
exist for these functions. 

infinite number of maxima and minima exist within a single period of g(t). 
Condition (3) is satisfied as there are no discontinuities within a single period 
of g(t). 

(iii) The CT function x(t) is plotted in Fig. 4.22(c). Condition (1) is satisfied 
as the area enclosed by |x(f)l is finite. Condition (2) is violated as there are an 
infinite number of maxima and minima within a single period of g(t). Condition 
(3) is violated as an infinite number of discontinuities exist within a single period 
of g(t). 



-1 - 0.5 0 0.5 1 1.5 2 

(d) 


4.8 Application of Fourier series 


The exponential CTFS has several interesting applications. In Section 4.7.1, we 
highlight an application of the CTFS representation in calculating the sum of 
an infinite series. Section 4.7.2 considers the use of the CTFS representation in 
calculating the response of an LTIC system to a periodic signal. By using the 
CTFS representation, we avoid the convolution integral. 

4.8.1 Computing the sum of an infinite series 

The following example illustrates an application of the CTFS in calculating the 
sum of a series: 

Example 4.24 

Calculate the sum S of the following infinite series: 

_ ^ 1 1111 1 
S ~ ^ (2 n + l ) 4 ~ 1 + ^ + 5 ^ + 74 + 9 ? + Ii i: + ‘‘‘ 
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Solution 

To compute the sum S, we consider the periodic signal /(f) shown in Fig. 4.11. 
As shown in Example 4.13, the exponential CTFS coefficients of /(r) are given 
by 


D 


n 


o 

12 

( im ) 2 


n is even 
n is odd. 


Using Parseval’s theorem, the average power of /(f) is given by 

^ ^ “ 144 1 288 

P,= £ ID.I 2 = IO»l 2 + 2£lO,l 2 = 2£- r - ;? = - r S. 

n——oo n = 1 n=l 


(4.69) 


Using the time-domain approach, it was shown in Example 4.17 that the average 
power of /(f ) is given by 

OO 

Pf = jrJ im{2dt = 3 ' (4 ' 70) 

— OO 


Combining Eqs. (4.69) and (4.70) gives (288/7T 4 ) 

1 _ 3t r 4 ~ 4 

(2«TT/ “ 288 


5 = E 


IT 

56 


5 = 3 or 
« 1.014 7. 


4.8.2 Response of an LTIC system to periodic signals 

As a second application of the exponential CTFS representation, we consider the 
response y(t ) of an LTIC system with the impulse response h(t) to an periodic 
input x(t ). The system is illustrated in Fig. 4.23. Assuming that the input signal 
x(t ) has the fundamental period To, the exponential CTFS representation of 
x(t) is given by 

OO 

x{t)= J2 D n e inroot , (4.71) 

m= 0 

where the fundamental frequency coq — 2jt/Tq. The steps involved in calculat- 
ing the output y(f ) are as follows. 


x(t)- 

periodic 

input 



LTIC periodic 
system output 


Fig. 4.23. Response of an LTIC 
system to a periodic input. 


Step 1 Based on Theorem 4.3.1, the output of an LTIC system y„(t ) to a 
complex exponential x„(f) = D„exp(jnwof) is given by 


y„(f) = D n H(mi> o)e jn “° f , (4.72) 


where H(itu>q) — H(co), evaluated at u> = itu>q. The new term I! (o>) is referred 
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to as the transfer function of the LTIC system and is given by 

OO 

H{fi>)= J h(t)e~ iu,t dt. (4.73) 

— OO 

Step 2 Using the principle of superposition, the overall output y(t) by adding 
individual outputs y„(f) is given by 

OO 

y(o= E y n(t) (4 ' 74) 

n——oo 

or 

OO 

y(t)= D„e^'H(co) \ a=noi0 . (4.75) 

n = — oo 


Step 3 Based on Eq. (4.75), it is clear that the response y(t) of an LTIC system 
to a periodic input x{t ) is also periodic with the same fundamental period as 
x(t). In addition, the exponential CTFS coefficients E n of the output y(t) are 
related to the CTFS coefficients D n of the periodic input signal x(t) by the 
following relationship 

E n = D n H(co) !«,=„«*. (4.76) 


Example 4.25 

Calculate the exponential CTFS coefficients of the output y(t) if the square 
wave x(t ) illustrated in Fig. 4.14 is applied as the input to an LTIC system with 
impulse response h(t) = exp(— 2 t)u(t). 


Solution 

The exponential CTFS coefficients of the square wave x(t ) shown in Fig. 4. 14(a) 
are given by (see Example 4.14) 


1 / n \ 

D„ = -smc^-j, 


for — oo < n < oo. 


The transfer function H (o>) of the LTIC is given by 

OO OO 

H{co)= f /?(f)e- j “"df = / e - (2 +j w) 'd t= . (4.77) 

J J (2+jw) 

— oo 0 

For a>o — 1 radian/s, the exponential CTFS coefficients of the output y(t) are 
given by 

1 sinc(/7 /4) 


1 /n \ 

E n = D n H{co) \a, =n = - stnc^-J x 
and the output y(t) is given by 


(2+jn) 8 + j4« 


y(t)= £ £ ^e^. 


(4.78) 


(4.79) 


8 + j4n 
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Fig. 4.24. Response of the LTIC 
system in Example 4.25. 



Using the Matlab function ictf s . m (provided in the accompanying CD), 
y(f) is calculated and shown in Fig. 4.24. It is observed that y(t ) does not have 
any sharp (rising or falling) edges. This is primarily because, at high frequencies, 
the gain of the system (|//(&>)|) is small. As the high-frequency components 
of the inputs are suppressed by the system, the sharp edges are absent at the 
output. 

Example 4.25 used the CTFS to calculate the output y(t) of a periodic signal 
x(t). Such a method is limited to periodic input signals. In Chapter 5, we show 
how the continuous-time Fourier transform (CTFT) can be used to compute the 
output of the LTIC systems for both periodic and aperiodic inputs. Since the 
CTFT is more inclusive than the CTFS representation, our analysis of the LTIC 
systems will be based primarily on the frequency decompositions using the 
CTFT. The CTFS is, however, used indirectly to compute the CTFT of periodic 
signals. We shall explore the relationship between the CTFS and CTFT more 
fully in Chapter 5. 


4.9 Summary 


In Chapter 4, we introduced frequency-domain analysis of periodic sig- 
nals based on the trigonometric and exponential CTFS representations. In 
Sections 4.1 and 4.2, the basis functions are defined as a complete set {p„(t)}, 
for 1 < n < N, of orthogonal functions satisfying the following orthogonality 
properties over interval [t\, t 2 \: 

h 

orthogonality property / Pm(t)p*(t)dt = 

ti 

for 1 < m,n < N , 


E n / 0 m = n 
0 m ^ n 
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for any pair of functions taken from the set {p n (t)}. Section 4.3 proves that 
the complex exponentials {exp(jn&>of)}, for — oo < n < oo, and sinusoidal 
functions {sin(«&>oO> 1. cos(/w<woO}> f° r 0 < m < oo, form two complete 
orthogonal sets over any interval [q , t\ + 2n /®o] of duration Tq — 2tx /mq. We 
refer to &>o as the angular frequency and to its inverse To = 2n / u>q as the funda- 
mental period. Expressing a periodic signal x(t) as a linear combination of the 
sinusoidal set of functions {sin(«&>oO, 1, cosiyncoot)} leads to the trigonometric 
representation of the CTFS. The trigonometric CTFS is defined as follows: 

OO 

x (t) = ao + ^ (a , , cos(na)ot) + b n sin(w£«oO), 

n = 1 


where coq — 2tc/ Tq is the fundamental frequency of x(t ) and coefficients ao, a n , 
and b n are referred to as the trigonometric CTFS coefficients. The coefficients 
are calculated using the following formulas: 


a o 


a n 


% / ' < ' )d '- 

(To) 



x(t)cos(ncoot)dt, 


and 



x(t) sin(/7tt)of)df. 


The trigonometric CTFS is presented in Section 4.4, while its counterpart, the 
exponential CTFS, is covered in Section 4.5. The exponential CTFS is obtained 
by expressing the periodic signal x(t ) as a linear combination of complex expo- 
nentials {expf jHcuoO} and is given by 

OO 

x(t)= D « e '"“ 0 '’ 

m=—oo 


where the exponential CTFS coefficients D n are calculated using the following 
expression: 

D n = y J 

(To) 

The exponential CTFS has several interesting properties that are useful in the 
analysis of CT signals. 

(1) The linearity property states that the exponential CTFS coefficients of a 
linear combination of periodic signals are given by the same linear combi- 
nation of the exponential CTFS coefficients of each of the periodic signals. 

(2) A time shift of to in the periodic signal does not affect the magnitude of the 
exponential CTFS coefficients. However, the phase changes by an additive 
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factor of ±na>oto , the sign of the phase change depending on the direction 
of the shift. This property is referred to as the time-shifting property. 

(3) The exponential CTFS coefficients of a time-reversed periodic signal are 
the time-reversed CTFS coefficients of the original signal. 

(4) If a periodic signal is time-scaled, the exponential CTFS coefficients are 
inversely time-scaled. 

(5) The exponential CTFS coefficients of a time-differentiated periodic signal 
are obtained by multiplying the CTFS coefficients of the original signal by 
a factor of 

(6) The exponential CTFS coefficients of a time-integrated periodic signal are 
obtained by dividing the CTFS coefficients of the original signal by a factor 
of j«&>o. 

(7) For real-valued periodic signals, the exponential CTFS coefficients D n and 
D „ are complex conjugates of each other. 

(8) Based on Par seval’ s property , the power of a periodic signal x(t) with the 
fundamental period of Tq is computed directly from the exponential CTFS 
coefficients as follows: 


The plot of the magnitude | D n | of the exponential CTFS coefficients versus the 
coefficient number n is referred to as the magnitude spectrum, while the plot of 
the phase <D n of the exponential CTFS coefficients versus the coefficient num- 
ber i i is referred to as the phase spectrum of the periodic signal xit). Section 4.6 
covers the conditions for the existence of the CTFS representations, and Section 
4.7 concludes the chapter by calculating the output response y(t) of an LTIC 
system to a periodic input x(t). In such cases, the output y(t) is given by 


where the transfer function H(w) is obtained from the impulse response hit) of 
the LTIC system as follows: 


The above expression also defines the continuous-time Fourier transform 
(CTFT) for aperiodic signals, which is covered in depth in Chapter 5. 



OO 


y(t) = J2 \ 


n=—o o 


OO 



— OO 


Problems 


4.1 Express the following functions in terms of the orthogonal basis functions 
specified in Example 4.2 and illustrated in Fig. 4.3. 
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(a) x\(t) = 


(b) x 2 (t) = 


(c) x 3 (t) = 

4.2 For the functions 


A 0 < t < T 
-A -T <t < 0; 
T 

A - <\t\<T 

-A 0<|f|<|; 

T 

A 

0 0<|f|<|. 


< p\{t ) = e 2|f ' and 4> 2 (t) = 1 — Ke 41,1 

determine the value of K such that the functions are orthogonal over the 
interval [— oo, oo]. 

4.3 The Legendre polynomials are widely used to approximate functions. An 
nth-order Legendre polynomial P n (x) is defined as 

1 d" M 

Pn(x) = -rr^— O 2 - D" = Ya nm X m , 

n i ) n n Y n ^ 

w=0 


n\2" dx 

where the values of a nm can be expressed as follows: 

a nm = J2 {-l) (n ~ m)/2 


(n + m)l 


m= 0 
n,m odd 
n,m even 


2 "ml(n — m/2)\(n +m/2)\ 


Note that a nm is non-zero only when both n and m are either odd or even. 
For all other values of n and m , a m „ is zero. The first few orders of Legendre 
polynomials are given by 

P 0 (x)= 1; P 2 (x) = l -Ox 2 - 1); 

P\{x) = X\ P-i(x) = ^(5x 2 - 3x); 

and are shown in Fig. P4.3. 

The Legendre polynomials {P„(x),n = 0,1,2,...} form a set of 
orthogonal functions over the interval [—1, 1] by satisfying the follow- 
ing property: 

l 

J P m (x)P n (x)dx 

Yen tv the above orthogonality condition for m, n — 0, 1, 2, 3. 

4.4 The Chebyshev polynomials of the first kind are used as the approximation 
to a least-squares fit. The ;;th-order polynomial T„(x) can be expressed as 


2m + 1 

0 m ^ n. 
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Fig. P4.3. Legendre 
polynomials with order 0-3. 


Fig. P4.4. First few orders of 
Chebyshev polynomials of the 
first kind. 




follows: 


T„(x) = 


n 

2 


L«/2j 


E 


0 n-k - 1)! 
k\(n - 2k)\ 


(2a) 


n—2k 


n = 0, 1,2, 3, ... 


The first few Chebyshev polynomials are given by 


7o(x) = 1; 

T\(x) = x; 

Ti{x) = lx 1 — 1; 


Ti(x) = 4.v 3 — 3 a; 

T 4 (x) = 8.Y 4 — 8.v 2 + 1; 
T 5 (x) — 16a -5 — 20a 3 + 5a; 


which satisfy the following relationship: 


T;, + i(a) = 2xT„(x) - T;,_i(a) 


and are shown in Fig. P4.4. 

The Chebyshev polynomials {T n ( a), n = 0, 1, 2, . . .} form an orthog- 
onal set on the interval [—1, 1] with respect to the weighting function by 
satisfying the following: 


1 

/ 

-l 




zT m (x)T n (x)dx 


n m = n = 0 

jr/2 m = n = 1, 2, 3 
0 m ^ n. 


Verify the above orthogonality condition for m,n — 0, 1, 2, 3, 4. 

4.5 The Haar functions are very popular in signal processing and wavelet appli- 
cations. These functions are generated using a scale parameter ( m ) and a 
translation parameter («). Let the mother Haar function (m = n — 0) be 
defined as follows: 


/ 1 0 < f < 0.5 

-1 0.5 < 1 < 1 
\ 0 otherwise. 


H 0 ,o(0 = 
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1 

1 





0 

0.5 

1.0 




l 



0 0.5 


1.0 


^2,o(0 

1 


-+t 


^2,l(0 


0.5 


1.0 


-►r 


# 2 , 2 « 


0.5 


1.0 


0.5 


-►/ 


# 2 , 3(0 


1.0 


0.5 


-►r 


1.0 


Fig. P4.5. Haar functions for The other Haar functions, at scale m and with translation n, are defined 

m = 0, 1, and 2. using the mother Haar function as follows: 

= //o,o(2 m f -n), n = 0, 1, , (2 m - 1). 

The Haar functions for m = 0, 1, 2 are shown in Fig. P4.5. 

Show that the Haar wavelet functions {H m „(f), m = 0, 1,2,..., n = 
0, 1,2,... (2 m — 1)} form a set of orthogonal functions over the interval 
[0, 1 ] by proving the following: 

l 

J H m Jt)H M (t)dt = 

o 


2 m = p,n = q 

0 otherwise. 


4.6 Calculate the trigonometric CTFS coefficients for the periodic functions 
shown in Figs. P4.6(a)-(e). 

(a) Rectangular pulse train with period 2 n : 


* 1(0 = 


3 for 0 < t < 7T 
0 for 7 r < t < 2 j r. 


(b) Raised square wave with period 2 T : 

0.5 for - 


x2(r) = 


-T T 

— < t < — 
2 ~ 2 


T 3 T 

1 for — < t < — . 

2 ~ 2 


(c) Half sawtooth wave with period T : 


x3(t) = 1 - - for 0 <t <T. 
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(b) 


*3(0 


► t 


-AT 

(c) 
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A 
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V\/ - 


-AT 

(d) 


-2 T 


2 T 


AT 


Fig. P4.6. Periodic functions in 
Problem 4.6; (a)-(e) refer to the 
Problem. 



(e) 


(d) Sawtooth wave with period 2 T : 

x4(t)=l-|^ 

(e) Periodic wave with period 2 T . 

*5(0 


tor —T < t < T. 


1° 

ntt\ 

for 

—T < t < 0 

I 1 - 0.5 sin ( 

,t) 

for 

0 < t < T. 


4.7 Calculate the trigonometric CTFS coefficients for the periodic function 
shown in Fig. P4.7. Note that the function 

k—oo 

s(t) = S(t-kT) 

k=—o o 


is known as the sampling function and that it is used to obtain a discrete- 
time signal by sampling a continuous-time signal (see Chapter 9). 


4.8 Calculate the trigonometric CTFS coefficients for the following functions: 

(i) x,(t) = cos It + sin(15f + tt/2); 

(ii) *2(0 = 3 + sin2f + cos(4r + jr/4); 

(iii) * 3 (0 = 1.2 + el 2,+1 + e-i (5,+2) + e -J (3,+1) ; 

(iv) * 4(0 = e' +1 + e j (2f+3) . 


4.9 Show that if x(t) is an even periodic function with period To, the expo- 
nential CTFS coefficients can be calculated by evaluating the following 
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Fig. P4.7. Periodic function (an 
impulse train with period T) in 
Problem 4.7. 


-t t t t 

-AT -2T 


s(t) 

1 




► 


IT 4 T 


t 


integral: 


where a>o — 2it /T q. 


2 

To 


To/2 

J x{t) cos(nwot)dt , 
o 


4.10 Show that if x (t ) is an odd periodic function with period To, the exponential 
CTFS coefficients can be calculated by evaluating the following integral: 


— 2j 


To/2 

h 


D " = — I x(t)sm(nco 0 t)dt, 


where wq = 2jt /T q. 


4.11 For the periodic functions shown in Fig. P4.6: 

(i) calculate the exponential CTFS coefficients directly using Eq. (4.44); 

(ii) plot the magnitude and phase spectra. 


4.12 Repeat Problem 4.11 for the function shown in Fig. P4.7. 

4.13 For the periodic functions shown in Fig. P4.6, calculate the exponential 
CTFS coefficients by applying Eq. (4.45) to the trigonometric CTFS coef- 
ficients calculated in Problem 4.6. Compare your answers with the CTFS 
coefficients obtained in Problem 4.11. 


4.14 Consider the raised square wave shown in Fig. P4.6(b). Using the time- 
differentiation property and the exponential CTFS coefficients calcu- 
lated in Problem 4.11, calculate the exponential CTFS coefficients of an 
impulse train with period To = 2T , with impulses located at '/’/2 + 2kT 
with k e Z. 


4.15 Calculate the exponential CTFS coefficients for the functions given in 
Problem 4.8. 


4.16 The derivative of the square wave x{t) shown in Fig. 4. 14 can be expressed 
in terms of two shifted impulse trains as 



Using the time-shifting and time-scaling properties, express the exponen- 
tial CTFS coefficients D n for the square wave in terms of the exponential 
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CTFS coefficients E n of the impulse train. Calculate the CTFS coef- 
ficients of the square wave and compare with the values evaluated in 
Example 4.14. 

4.17 Repeat Example 4.22 with the following values of x and T such that the 
duty cycle ( x/T ) is fixed at 0.2: 

(i) r = 1 ms, T = 5 ms; 

(ii) x = 2 ms, T = 10 ms; 

(iii) % = 4 ms, T = 20 ms. 

Discuss the changes in the CTFS representations for the above selections 
of r and T . 


4.18 For the periodic functions shown in Fig. P4.6: 

(i) calculate the average power in the time domain, and 

(ii) calculate the average power using Parseval’s theorem. Verify your 

result with that obtained in step (i). „ =00 

[Hint: If you find it difficult to calculate the summation E i^i 2 

n =— oo 

analytically, write a Matlab program to calculate an approximate 
11=00 

value of I D n I 2 for - 1000 < n < 1000.] 

n = — oo 


4.19 Determine whether the periodic functions shown in Fig. P4.6 satisfy the 
Dirichlet conditions and have CTFS representation. 

4.20 Determine if the following functions satisfy the Dirichlet conditions and 
have CTFS representation: 

(i) x(t) = l/t, t = (0, 2] and x{t) = x(t + 2); 

(ii) g(t) = cos()r/2f), t = (0, 1] and g(t) = g(t + 1); 

(iii) h(t) — sin(ln(f)), t = (0, 1] and h(t) = h(t + 1). 


4.21 Consider the periodic signal /(f) considered in Example 4.9 and shown 
in Fig. 4.1 1. From the CTFS representation, prove the following identity: 

7 X 2 _ 111 

y- 1+ 3^ + 5^ + T- + '" ' 

4.22 From the half sawtooth wave shown in Fig. P4.6(c) and its trigonometric 
CTFS coefficients (calculated in Problem 4.6(c)), prove the following 
identity: 

t r 11111 

_ = 1 1 1 1 . 

4 3 5 7 9 11 

[Hint: Evaluate the function at / = T /4.] 

4.23 Using the exponential CTFS coefficients of the function shown in 
Fig. P4.6(c) (calculated in Problem 4.1 1) and Parseval’s power theorem, 
prove the following identity: 

7 r 2 _ 1111 

— - 1+ 22 + 32 + 42 + 52 + "' ' 


6 
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4.24 The impulse response of an LTIC system is given by 

h(t) = e“ 2|f| . 

(a) Based on Eq. (4.54), calculate the transfer function // (&>) of the LTIC 
system. 

(b) The plot of magnitude |//(&>)| with respect to <wgs referred to as the 
magnitude spectrum of the LTIC system. Plot the magnitude spectrum 
of the LTIC system for the range — oo < a> < oo. 

(c) Calculate the output response y(t) of the LTIC system if the impulse 
train shown in Fig. P4.7 is applied as an input to the LTIC system. 

4.25 Repeat P4.24 for the following LTIC system: 

h(t) = [e -2 ' - e- 4 ']«(0, 

with the raised square wave function shown in Fig. P4.6(b) applied at the 
input of the LTIC system. 

4.26 Repeat P4.24 for the following LTIC system: 

hit) = re~ 4 'zz(f), 

with the sawtooth wave function shown in Fig. P4.6(d) applied at the input 
of the LTIC system. 

4.27 Consider the following periodic functions represented as CTFS : 

7 OO | 

(i) xi (t) = - V — sin[87r(2m + l)f]; 

77 £=6 2m + 1 
OO | 

(ii) X 2 it) — 1.5 + cos[27r(4flz + 1)?]. 

' Am + 1 

m= 0 

(a) Determine the fundamental period of x(t). 

(b) Determine if x{t) is an even signal or an odd signal. 

(c) U sing the i c t f s . m function provided in the CD, calculate and plot 
the functions in the time interval — 1 < t < 1 . [Hint: You may calcu- 
late x(t) for t = [—1:0.01:1], The Matlab "plot" function will 
give a smooth interpolated plot.] 

(d) From the plot in step (c), determine the period of x(t). Does it match 
your answer to part (a)? 

4.28 Using the Matlab function ictfs.m (provided in the CD), show 
that the periodic function fit ) (shown in Fig. 4.10) considered in 
Example 4.8, can be reconstructed from its trigonometric Fourier series 
coefficients. 

4.29 Using the Matlab function ictfs.m (provided in the CD), show that 
the periodic function git ) (shown in Fig. 4.11) considered in Example 4.9, 
can be reconstructed from its trigonometric Fourier series coefficients. 
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4.30 Using the Matlab function ictfs .m (provided in the CD), show that 
the periodic function g(t) (shown in Fig. 4 . 10 ) considered in Example 

4 . 12 , can be reconstructed from its exponential Fourier series coefficients. 

4.31 Using the Matlab function ictfs . m (provided in the CD), show that 
the periodic function f(t) (shown in Fig. 4.11) considered in Example 

4 . 13 , can be reconstructed from its trigonometric Fourier series coeffi- 
cients. 

4.32 Using the Matlab function ictfs . m (provided in the CD), plot the 
output response y(t ) obtained in Problem 4.24 for T = Is. 

4.33 Using the Matlab function ictfs . m (provided in the CD), plot the 
output response y(t) obtained in Problem 4 . 25 . for T = Is. 


CHAPTER 



Continuous-time Fourier transform 


In Chapter 4, we introduced the frequency representations for periodic sig- 
nals based on the trigonometric and exponential continuous-time Fourier series 
(CTFS). The exponential CTFS is useful in calculating the output response of 
a linear time-invariant (LTI) system to a periodic input signal. In this chapter, 
we extend the Fourier framework to continuous-time (CT) aperiodic signals. 
The resulting frequency decompositions are referred to as the continuous-time 
Fourier transform (CTFT) and are used to express both aperiodic and periodic 
CT signals in terms of linear combinations of complex exponential functions. 
We show that the convolution in the time domain is equivalent to multiplication 
in the frequency domain. The CTFT, therefore, provides an alternative analysis 
technique for LTIC systems in the frequency domain. 

Chapter 5 is organized as follows. Section 5.1 considers the CTFT as a 
limiting case of the CTFS and formally defines the CTFT and its inverse. In 
Section 5.2, we provide several examples to illustrate the steps involved in the 
calculation of the CTFT for a number of elementary signals. Section 5.3 presents 
the look-up table and partial fraction methods for calculating the inverse CTFT. 
Section 5.4 lists the symmetry properties of the CTFT for real- valued, even, and 
odd signals, while Section 5.5 lists the CTFT properties arising due to linear 
transformations in the time domain. The condition for the existence of the 
CTFT is derived in Section 5.6, while the relationship between the CTFT and 
the CTFS for periodic signals is discussed in Sections 5.7 and 5.8. Section 5.9 
applies the convolution property of the CTFT to evaluate the output response of 
an LTIC system to an arbitrary CT input signal. The gain and phase responses 
of LTIC systems are also defined in this section. Section 5.10 demonstrates how 
M ATL AB is used to compute the CTFT, and Section 5. 1 1 concludes the chapter. 


5.1 CTFT for aperiodic signals 
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Consider the aperiodic signal x{t) shown in Fig. 5.1(a). In order to extend 
the Fourier framework of the CTFS to aperiodic signals, we consider several 
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Fig. 5.1. Periodic extension of a 
time-limited aperiodic signal. 

(a) Aperiodic signal and (b) its 
periodic extension. 



(a) 


(b) 


repetitions of x(t) uniformly spaced from each other by duration Tq such that 
there is no overlap between two adjacent replicas of x(t). The resulting signal 
is denoted by Xj{t) and is shown in Fig. 5.1(b). Clearly, the new signal Xj(t) is 
periodic with the fundamental period of Tq and in the limit 


lim x T (t) — x(t). (5.1) 

To— too 

Since xj(t) is a periodic signal with a fundamental frequency of ol>q = 2 tt/Tq 
radians/s, its exponential CTFS representation is expressed as follows: 

OO 

x T (t)= D n e) nwo> , (5.2) 

n=—o o 


where the exponential CTFS coefficients are given by 

d„ = y q J xAtys-^d t. 

(To) 


(5.3) 


The spectra of Xr(t) are the magnitude and phase plots of the CTFS coefficients 
D„ as a function of hcoq. Because n takes on integer values, the magnitude 
and phase spectra of 5cj(t) consist of vertical lines separated uniformly by 
two. Applying the limit Tq —> oo to Xr(t) causes the spacing wq = 2n /Tq in 
the spectral lines of the magnitude and phase spectra to decrease to zero. The 
resulting spectra represent the Fourier representation of the aperiodic signal x(t ) 
and are continuous along the frequency (&>) axis. The CTFT for aperiodic signals 
is, therefore, a continuous function of frequency o>. To derive the mathematical 
definition of the CTFT, we apply the limit Tq — > oo to Eq. (5.3). The resulting 
expression is as follows: 

lim D„ = lim — f ;t(r)e _i "“ 0 'dr 
r 0 ->oo 7b->oo To J 
(To) 


or 


D n 


Inn — 

To -*- oo Tq 


OO 

hf 


x(t)e,-i nc0 °‘dt 


since lim xr(t) = x(t). 
To^o 


(5.4) 


In Eq. (5.4), the term D„ denotes the exponential CTFT coefficients of x(t). 
Let us define a continuous function X (co) (with the independent variable o>) as 
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follows: 


OO 

X(co)= J x{t)e~ iat dt . (5.5) 

—(X) 

In terms of X(a>), Eq. (5.4) can, therefore, be expressed as follows: 

D„ = lim -^-X(«« 0 ). (5.6) 

Tq—ioo i 0 

Using the exponential CTFS definition, x(t) can be evaluated from the CTFS 
coefficients D n as follows: 

OO OO-i 

X(t)= Y D n e ina, ° r — lim Y xrXinwo)^'. (5.7) 

nt^oo r »-°° B =r : ' X T 0 

As 7o — >■ oo, the fundamental frequency w o approaches a small value denoted by 
A (D. The fundamental period 7 0 is therefore given by 7 0 = 2nlAco. Substituting 
To = In I Am as mq — > Am in Eq. (5.7) yields 

j OO 

x(t) = — lim V X(n Am) e^ nAa> ' Am. (5.8) 

2tT Aco^-0 ' 
n=—oo 

V“" ' 

A 

In Eq. (5.8), consider the term A as illustrated in Fig. 5.2. In the limit Am — » 0, 
term A represents the area under the function A(a>)exp(ja>f). Therefore Eq. 
(5.8) can be rewritten as follows: 

OO 

CTFT synthesis equation x(t) = — = f X dt , (5.9) 

2jt J 

— OO 

which is referred to as the synthesis equation for the CTFT used to express 
any aperiodic signal in terms of complex exponentials, exp(jrwf). The analysis 
equation of the CTFT is given by Eq. (5.5), which, for convenience of reference, 
is repeated below. 

OO 

CTFT analysis equation X(oj) = J jt(f)e- j “'df . (5.10) 

— OO 


Fig. 5.2. Approximation of the 

oo 

term X(nAio) 

n=—oo 

gj/lAmf as (hg area unc | er (hg 

function X (w)e\p(]cot). 
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Collectively, Eqs. (5.9) and (5.10) form the CTFT pair, which is denoted by 

DTFT . 

x(t ) < > X(a>). (5.11) 

Alternatively, the CTFT pair may also be represented as follows: 

Z(<y) = »W0} (5.12) 

or 

x(t) = » _i {AT(&j)}, (5.13) 

where 3 denotes for the CTFT and 3 1 denotes the inverse of the CTFT. Based 

on Eqs. (5.10) and (5.11), we make the following observations about the CTFT. 

(1) The frequency representation of a periodic signal x(t) is obtained by 
expressing x(t) in terms of the CTFS. The basis function of the CTFS 
consists of complex exponentials {exp(j«&)oO}, which are defined at the 
fundamental frequency coq and its harmonics nco o . The frequency repre- 
sentation of an aperiodic signal x(t ) is obtained through the CTFT, where 
the complex exponential exp(j ncot) is the basis function. The variable co 
in the basis function of the CTFT is a continuous variable and may have 
any value within the range — oo < co < oo. Unlike the CTFS, the CTFT is 
therefore defined for all frequencies co. 

(2) In general, the CTFT X(co) is a complex function of the angular frequency 
co. A great deal of information is obtained by plotting the magnitude and 
phase of X(a>) with respect to co. The plots of magnitude X (&>)] and phase 
< X(co) with respect to co are, respectively, referred to as the magnitude and 
phase spectra of the aperiodic function x(t). 

(3) In deriving the definition of the CTFT, we assumed that the aperiodic 
function x(t) is time-limited such that x(t) = 0 for f > L. This is not 
a required condition for the existence of the CTFT. In other words, the 
function x(t) may be infinitely long but its CTFT can exist. 

5.2 Examples of CTFT 


In Section 5.2, we calculate the forward and inverse CTFT of several well known 
functions. We assume that the CTFT exists in all cases. A general condition for 
the existence of the CTFT is derived in Section 5.6. 

Example 5.1 

Determine the CTFT of the following functions and plot the corresponding 
magnitude and phase spectra: 

(i) x\ (f) = exp(— at)u{t), a e R + \ 

(ii) X 2 (t) = exp(— a\t\), a e R + . 
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Table 5.1. Magnitude \X(w)\ and phase <X ( co ) for the CTFT of x(t) = exp(-3 t)u(t) in Example 5.1 


a) (radians/s) — oo —1000 —100 —10 —1 0 1 10 100 oo 

Magnitude: \X(io)\ 0 0.001 0.01 0.096 0.316 0.333 0.316 0.096 0.01 0 

Phase: <X(co) n/2 1.57 1.54 1.28 0.32 0 -0.32 -1.28 -1.54 -jr/2 


The notation a e R + implies that a is real-valued within the range — oo < 
a < oo. 


Solution 

(i) Based on the definition of the CTFT, Eq. (5.10), we obtain 


X\(co) = 3{e- fl, n(f)} = 


OO 

J e~ at u(t)e~^" > ‘ dt 


— OO 


OO 

J e -(a+]w)t At 

o 


_ 1 r p -(a+j®)n°° 

(«+j«) L Jo 


1 

(a +j co) 


[ lim e - (fl+j,u)r - ll , 

Lf — ^ OO J 


where the term 


lim e- {a+io,)t = lim e~ at ■ lim e^' = 0 • lim e^' = 0. 

t—> OO t—> OO t— i-OO t—HX> 


Therefore, 


xm = 


1 


a +)w 

The magnitude and phase of X i (co) are given by 


magnitude |Xi(a>)| 




; ■ i" 


1 


\fa 2 + co 1 


1 


phase <Xi (co) = < = <1 — <(a + ja>) = 

a + )co 


= —tan ( — 


■0 


Table 5.1 lists the amplitude and phase of X(co) for several values of co with 
a — 3. The exponentially decaying function x\ (t) and its magnitude and phase 
spectra are plotted in Fig. 5.3. 

(ii) Based on the definition of the CTFT, Eq. (5.10), we obtain 


X 2 (co) = 3{e- fl|r| } 


J e _a|,| e _ j® r dt 


— OO 


OO 


OO 



~ altl cos(&;f)dr - j 

V ^ 

even function 



“ a|f| sin(a>r)dr. 

odd function 


Since the integral of an odd function with limits [— L, L] is zero, the above 
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Fig. 5.3. CTFT of the causal 
decaying exponential function 
x(t) = equity (a) x(ty, 

(b) magnitude spectrum; 

(c) phase spectrum. 


equation reduces to 


X 2 (co) = 


= J e a|d cos(ft>r)dr = 2 J i 


cos(cot)dt = 2 / e cos(ttit)df 
-00 0 
2 


r [— ae cos(a)f) + we“ ar sin(<wf)]o = 


2a 


a 2 + a/ a z + ru 2 


Since ^(rw) is positive real-valued, the magnitude and phase of X 2 (<'jj) are given 
by 


magnitude 

phase 




2 a 

a 2 + co 2 


2 a 

a 2 + co 2 


<X 2 (co ) = 0. 


The non-causal exponentially decaying function x 2 (t) and its magnitude and 
phase spectra are plotted in Fig. 5.4. 


We note from Example 5.1 that the magnitude spectrum is symmetric along 
the vertical axis while the phase spectrum is symmetric about the origin. The 
magnitude spectrum is, therefore, an even function of a>, while the phase spec- 
trum is an odd function of co. This is a consequence of the symmetry properties 
observed by real-valued functions. The symmetry properties are discussed in 

Fig. 5.4. CTFT of the causal detail in Section 5 - 3 - 

decaying exponential function 
* 2(0 = exp(-a|f|). (a) x 2 (t); 

(b) Magnitude spectrum; Example 5.2 

(c) phase spectrum for a > 0. Calculate the CTFT of a constant function x(t) = 1 . 



(a) 


(b) 


(c) 
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1 

*(0 = 1 


2k j 

^ X(co) = 2k5{co) 



► t 


\xm 


<X(co) = 0 
► » 


(a) (b) 

Fig. 5.5. CTFT of a constant Solution 

function, (a) Constant function, Based on the definition of the CTFT, Eq. (5.10), we obtain 

x(t) = 1; (b) its CTFT, 

X (o>) = 2 ttS(co). 

X(co) = 3{l}= / e _j “'df. (5.14) 

— OO 

It can be shown that (see Problem 5.10) 

OO 

J e jtu 'dr = 27tS(w). (5.15) 

— OO 

Substituting co by — <x> on both sides of Eq. (5.15), we obtain 

OO 

J e ~ j“"df = 2 tt8{—co) = 2tc8(co), 

— OO 

which results in 

OO 

X(a>) = J e- jt0 'df = 2jtS(a>). 

— OO 

In other words, 

CTFT 

1-^27tS(co). (5.16) 

The magnitude spectrum of a constant function x(t ) = 1 therefore consists of 
an impulse function with area 2n located at the origin, o> = 0, in the frequency 
domain. The magnitude spectrum is plotted in Fig. 5.5(b). The phase is zero for 
all frequencies (oo < co < — oo). 

Example 5.3 

The CTFT of an aperiodic function g(t ) is given by G{co ) = 2jt8(co). Determine 
the aperiodic function g(t). 

Solution 

Based on the CTFT analysis equation, Eq. (5.10), we obtain 

OO OO 

g(t) = <$(«)} = J 2it8(co)e ia,, dco = J 8(co)dco = 1. 

— OO — OO 
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1 


(a) 


Fig. 5.6. CTFT of an impulse 
function, (a) Impulse function, 
x(t) = 5(f); (b) its CTFT, 

X(a>) = 1. 


x(f) = 5(f) 


+-t — 

(b) 


1 *(») = 1 


0 


\X(co)\ 

<X(w) = 0 
►£ 0 


In other words, 


CTFT 

1 ^-2jtS(w). (5.17) 

Combining the results in Examples 5.2 and 5.3, we obtain the CTFT pair: 

CTFT 

1 < A 2tt8(w). (5.18) 


Example 5.4 

Determine the Fourier transform of the impulse function x{t) — S(t). 


Solution 

Based on the definition of the CTFT, Eq. (5.10), we obtain 


X(co) = »{<$(*)} = 


J 5(f)e" j<u, df = 


OO 

J S(t)dt = 1. 


— OO 


— OO 


Therefore, 


5(f) 


CTFT , 

> 1. 


The CTFT of the impulse function located at the origin (f = 0) is a constant. 
The magnitude spectrum is shown in Fig. 5.6. The phase spectrum is zero for 
all frequencies at. 


Example 5.5 

The CTFT of an aperiodic function g(t ) is given by G(o>) = 1. Determine the 
aperiodic function g(t). 

Solution 

Based on the CTFT analysis equation, Eq. (5.10), we obtain 

OO 

g(f) = £T*{1} = ^ f l-e j “'d t. 

— OO 


(5.19) 
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By interchanging the role of w and t in Eq. (5.15), we obtain 

OO 

J e^'da > = 2nS(t). 

— OO 

Substituting the above relationship in Eq. (5.19) yields 

OO 

git) — — ~ f e J<u 'dr = -f x 2 jtS(t) = 5(f). 
Z7T J 2n 

— OO 

Therefore, 


CTFT 

5(f) < 1. (5.20) 

Combining the results derived in Examples 5.4 and 5.5, we can form the CTFT 
pair: 


5(f) 


CTFT 
•< >- 


1. 


(5.21) 


In Example 5.5, we proved that the inverse CTFT of G( a>) = 1 is given by the 
impulse function g(t) = 8(t). In Example 5.4, we showed the converse: that 
the CTFT of g(f) = 8(t) is G(a > ) = 1. Likewise, in Examples 5.2 and 5.3, we 
established the CTFT pair, 

CTFT 

1 < - > 2 tt8(co), 


by computing the forward and inverse CTFT. Since the CTFT pair is unique, 
it is sufficient to compute either the CTFT or its inverse. Once the CTFT is 
derived, its inverse is established automatically, and vice versa. In the remaining 
examples, we form the CTFT pair by deriving either the forward CTFT or its 
inverse. 

A second observation made from the CTFT pairs given in Eqs. (5.18) and 
(5.21), 

CTFT CTFT 

1 < > 2jt8(a>) and 5(f) > 1, 

is that the CTFT exhibits a duality property. The CTFT of a constant is the 
impulse function, while the CTFT of an impulse function is a constant. A factor 
of 2: r is also introduced. We revisit the duality property in Section 5.5. 


Example 5.6 

Calculate the CTFT of the rectangular function /(f) shown in Fig. 5.7(a). 


Solution 

Based on the definition of the CTFT, Eq. (5.10), we obtain 


r/2 

F(a>) = 3{rect(f/r)} = J 1 ■ e^" r df = 

— t/2 


' g— j cot - t /2 

.“j" J-r/2 5 
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(a) (b) 


Fig. 5.7. CTFT of the rectangular which simplifies to 
function, (a) Rectangular 

function; (b) its CTFT given by 1 

the sine function. (&,) = _ j« 6 L */ 2 


- — [e- ja,T/2 - e j “ T/2 ] = - — [— 2j sin ( — ) 

]a> )(x> L v 2 / 


or 


2 . 

(COT \ 

■ ( cor \ 

— sin 


= x sine — 

CO 

^ 2 ) 

\2tt) 


The Fourier transform F(tt>) is plotted in Fig. 5.7(b). The CTFT pair for a 
rectangular function is given by 


rect 



CTFT 

< > r sine 



(5.22) 


Example 5.7 

Determine the aperiodic function g(t ) whose CTFT G (o>) is the rectangular 
function shown in Fig. 5.8(a). 


Solution 

From Fig. 5.8(a), we observe that 


G(«) = 


1 

0 


M < w 

\a>\ > W . 


Based on the CTFT analysis equation, Eq. (5.10), we obtain 


w 


g(t) ■ 


1 I rect (— ) 

1 = 2- 

f 1 • e jw, dfti = — 


1 \2W ' 

1 2?r J 

2tt 

L v \ 


-w 


w 


-w 


(5.23) 


which simplifies to 


g(0 = — [e jM " - e-*"] = 


j27Tt 
W 

— sine 
7 r 


)2jxt 


[2j sin(VFt)] = 


sin(VF/) 
7 rt 


W 

— t 
7T 
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(a) (b) 


Fig. 5.8. Inverse CTFT of the 
rectangular function. 

(a) Frequency domain 
representation G(u>) = 
rect(<i>/2W0; (b) its inverse 
CTFT given by the sine function. 


The aperiodic function g(t) and its CTFT are plotted in Fig. 5.8. Example 5.7 
establishes the following CTFT pair: 


W . ! 

(W ' 

— sine 

— t 

n ' 

\ Tt 


CTFT 

< > rect 



1 \to\ < W 

o m > w. 


(5.24) 


Example 5.8 

Determine the signal x(t) whose CTFT is a frequency-shifted impulse function 
X(a > ) = 8(a) - ab- 


solution 

Based on the CTFT analysis equation, Eq. (5.10), we obtain 

OO 

x(t) = 3 _1 {<5(w - <wo)} = [ S(co- « 0 )e~ j "'d co 

27T J 

— OO 
OO 

1 r i 

= — e ](OQt I 8(co — coo)dco = — e ](OQt . 

In J 2n 

— OO 

Example 5.8 proves the following CTFT pair: 

CTFT 

e ja, ° ' » 2jt8(co - wo). ( 5 . 25 ) 

Substituting &>o by — coq in Eq. (5.25), we obtain another CTFT pair: 

CTFT 

e -j«or b- > 2n8(w + coq). (5.26) 

In Examples 5.1 to 5.8, we evaluated several CTFT pairs for some elementary 
time functions. Table 5.2 lists the CTFTs for additional time functions. In prac- 
tice, a graphical plot of the CTFT helps to understand the frequency properties 
of the function. In Table 5.3, we illustrate the frequency responses of several 
functions by plotting their magnitude and phase spectra. In the plots, the magni- 
tude spectra are shown as solid lines and the phase spectra are shown as dashed 
lines. In certain cases, the values of the corresponding phases are zero for all 
frequencies, and in these cases the phase spectra are not plotted. 
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Table 5.2. CTFT pairs for elementary CT signals 


CT signals 


Time domain 


Frequency domain 

oo oo 

r(0 = J j X(co)e ia, dt X(co) = J x(t)e~ iM dt 


Comments 


(1) Constant 

1 

(2) Impulse function 

<5(0 

(3) Unit step function 

«(0 

(4) Causal decaying 

e~ ar u(t ) 

exponential function 


(5) Two-sided decaying 

e~ a I'l 

exponential function 


(6) First-order time-rising 

ter a, u(t) 

causal decaying 


exponential function 


(7) IV th-order time-rising 

t n e~ a 'u(t) 

causal decaying 


exponential function 



(8) Sign function 

sgn(0 = 

_ 

(9) Complex exponential 

c k»o< 

(10) Periodic cosine function 

COStooO 

(11) Periodic sine function 

sin(woO 

(12) Causal cosine function 

costoof)n(f) 

(13) Causal sine function 

sin(woO !< (0 


(14) Causal decaying e - "' cos(woO M (0 

exponential cosine 
function 


(15) Causal decaying 
exponential sine function 

(16) Rectangular function 


e sin(woOw(0 



(17) Sine function 

(18) Triangular function 

(19) Impulse train 


W 

— sine 
n 




OO 

J2 S(t - kTo) 

k=— oo 


|f| < * 
otherwise 


27r<5(w) 

1 

1 

TrS(a>) + — 


a + jw 
2a 

a 2 + w 2 

1 

(a + jot) 2 
n\ 

(i a + jw)" +1 


2 

j" 

2jtS(co — cog) 

tr[<5(w — a>o) + <5(w + wo)] 

-r[<5(w - w 0 ) - <5(w + w 0 )] 

J 

7T j CO 

— [(5(a) — wo) + <5(w + wo)] H 5 7 

2 Wq — or 

7T Wo 

— [<5(w - wo) ~ S(co + wo)] H y y 


2j 


o + jw 


(a + jw) 2 + m 2 0 
wo 

(a + jw) 2 + ml 


sine ^ 


WT 

2tz ) 


\ 


rect 


/ w \ _ |1 |w| < W 


\2W / 0 |w| > W 


■ 1 ( (DT \ 
z sine — 

\2tz> 


wo E 8(co — ma)Q ) 

m=—oo 


(20) Gaussian function e ,2 / 2<t2 


as/ 2^e-‘ TWl2 


a > 0 
a > 0 
a > 0 

a > 0 


a > 0 


a > 0 
r 0 


T > 0 

angular 
frequency 
Wo = 2jr/T 0 


Table 5.3. Magnitude and phase spectra for selected elementary CT functions 
Magnitude spectra are shown as lines and phase spectra are shown as dashed lines 




s 


(10) Cosine function x(t) = cos(coot) *(0 ~ cos (co 0 t) _ 7r[5(fi>-a>o)+5(fiH-fi> 0 )] 


(12) Causal cosine function x(t) = cos(a) 0 t)u(t) x(t) - cos(a>„t)u(t) X(co)=*[d(io-co 0 )+5(a)-co 0 )] + jw/a^-to 2 



(i cont .) 


Function Time-domain waveform Magnitude and phase spectra 
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5.3 Inverse Fourier transform 


Evaluation of the inverse CTFT is an important step in analysis of LTIC systems. 
There are three main approaches that may be taken to calculate the inverse 
CTFT: 

(i) using the synthesis equation; 

(ii) using a look-up table; 

(iii) using partial fraction expansion. 

In the first approach, the inverse CTFT is calculated by solving the synthe- 
sis equation, Eq. (5.9). This method was used in Examples 5.3, 5.5, 5.7, and 
5.8. However, this approach is difficult. We now present the second and third 
approaches. Approach (ii) is straightforward as it determines the inverse CTFT 
by comparing the entries with Table 5.2. We illustrate this with an example. 


Example 5.9 

Using the look-up table method, calculate the inverse CTFT of the following 
function: 


X(co) = 


2(j co) + 24 
(j&0 2 + 4(jtt>) + 29 ' 


(5.27) 


Solution 

The function X(a>) is decomposed into simpler terms, whose inverse CTFT 
can be determined directly from Table 5.2. One possible decomposition is as 
follows: 


2 + (j&>) 

X(cu) = 2— — { + 4- 


” (2 + ]co) 2 + 5 2 (2 + j&>) 2 + 5 2 ' 

From Entries (14) and (15) of Table 5.2, we know that 


—2 1 /c \ / \ CTFT 

e cos(5 t)u(t) < > 


2+jft. 


and 


e 21 sin(5f)w(0 - > 


CTFT 


(2 + j®) 2 + 5 2 
5 


(2 + jtu) 2 + 5 2 ' 
Therefore, the inverse CTFT is calculated as follows: 


(5.28) 


x(t) — 2e 2 ' cos(5 t)u(t) + 4e 21 sin(5t)u(t). (5.29) 


5.3.1 Partial fraction expansion 

The look-up table approach is simple to use once a suitable decomposition is 
obtained. A major problem, however, is faced in the decomposition of the CTFT 
X ( co ) in terms of simpler functions whose inverse CTFTs are listed in Table 5.2. 
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We now present approach (iii), which uses the partial fraction expansion to 
decompose systematically a rational function in simpler terms. Consider the 
CTFT 


X(w) = 


N(w) 

~dW) 


b m (]co) m + 1 H |-fri(j<») + fro 

(j«) n +a„_i(j<w )"- 1 H bai(j<w) + ao 


(5.30) 


where the numerator is an /nth-order polynomial and the denominator is an 
nth-order polynomial. The partial fraction method is explained in more detail 
in Appendix D (see Section D.2). The main steps are summarized as follows. 


(1) Factorize D(a > ) into n first-order factors and express X (®) as follows: 


X{co) = 


N(oj) 

(j® - Pl)(jcO - p 2 ) ■ ■ ■ (j® ~ PnY 


(5.31) 


(2) If there are no repeated or complex roots in D(®), X (®) is expressed in 
terms of n partial fractions: 


X(p>) = 


h 


ki 


(jcu-pi) (j a>-p 2 ) 


+ 


k„ 

(j« - p„y 


(5.32) 


where the partial fraction coefficients are calculated using the Heaviside 
formula as follows: 


K = [(jto - p r )X(co)] ia>=Pr , (5.33) 

fori <r< n. For repeated or complex roots, the partial fraction expansion 
is more complicated and is discussed in Appendix D. 

(3) The inverse CTFT can then be calculated as follows: 

x(t) = [k\Q Plt + k 2 e P2 ' + ■ ■ • + k n e p " r ]u(t). (5.34) 


Example 5.10 

Using the partial fraction method, calculate the inverse CTFT of the following 
function: 


X(co) = 


5(ja>) + 30 

(j®) 3 + 17(j&>) 2 + 80(jft>) + 100' 


Solution 

In terms of j co, the roots of D(w) — (j®) 3 + 17(j®) 2 + 80(j®) + 100 are given 
by j® = —2, —5, and — 10. The partial fraction expansion of X (®) is given by 

_ 5(j®) + 30 _ k\ k 2 k 3 

X (co) — = “h ~l” , 

(j« + 2)(j® + 5)(j® + 10) (j® + 2) (jw + 5) (j® + 10) 
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where the partial fraction coefficients are given by 
5(j<w) + 30 


k\ = (j co + 2) — 

J (J® + 2)(ja> + 5)(j<w + 10) 

20 5 


5(ja>) + 30 


J a* 


=_2 (j® + 5)(j® + 10) 


(3)(8) 6’ 

; 7- , ^ 5(j<w) + 30 

= (| co + 5) 

(J® + 2)(j<y + 5)(jty + 10) 

5 1 


5(jw) + 30 


jtu: 


.——5 (j ® + 2)(j co + 10) 


jco — — 2 


jtu— — 5 


(-3)(5) 3’ 


and 


k 3 = (jtt>+ 10)- 


5(jo>) + 30 


(jw + 2)(ja> + 5)(jw + 10) 
20 _ 1 
“ ~ 2 ' 


5(jcn) + 30 


jw=-io (j® + 2)(ja> + 5) 


jco — — 10 


(-8X-5) 

Therefore, the partial fraction expansion of X (co) is given by 

5 1 1 

X(co) = . (5.35) 

6(j® + 2) 3(jw + 5) 2(j® +10) 

Using the CTFT pairs in Table 5.2 to calculate the inverse CTFT, the function 
x(t ) is calculated as 


x(t) = 


-e.~ 2 ‘ - -e' 5 ' - -e- 10r 
6 3 2 


u(t). 


(5.36) 


5.4 Fourier transform of real, even, and odd functions 


In Example 5. 1 , it was observed that the CTFT of a causal decaying exponential, 


„ t . . CTFT 
2 u(t) < >■ 


1 

(a +j®)’ 


has an even magnitude spectrum, while the phase spectrum is odd. This is 
known as Hermitian symmetry and holds true for the CTFT of any real-valued 
function. In this section, we consider various properties of the CTFT for real- 
valued functions. 


5.4.1 CTFT of real-valued functions 

5.4.1. 1 Hermitian symmetry property 

The CTFT X (co) of a real-valued signal x(t) satisfies the following: 

X(-co) = X*(co ) , (5.37) 

where X *(co) denotes the complex conjugate of X(co). 
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Proof 

By definition, 


X*{Q>) = [3{x(0}]* 


J x(t)e~ iu, 'dt = J 


= / [x(r)e -j<B, ]*df, 


which simplifies to 


X*(co) 


oo 

J x*(t)e} al dt. 

— CO 


Since x(t) is a real-valued signal, x*(t) = x{t) and we obtain 


X*(«) 


OO 

J x(Oe" j( “‘" ) 'd t = X(—co), 

— OO 


which completes the proof. 


The Hermitian property can also be expressed in terms of: (i) the real and 
imaginary components of the CTFT X{w), and (ii) the magnitude and phase 
of X(co). These lead to alternative representations for the Hermitian property, 
which are listed below. 


5.4.1. 2 Alternative form I for Hermitian symmetry property 

The real component of the CTFT X(co) of a real- valued signal x(t) is even, 
while its imaginary component is odd. Mathematically, 

Re{X(-tt>)} = Re{X(®)} and Im{X(-<y)} = -Im{X(<o)}. (5.38) 

Proof 

Substituting X (o>) = Re{ X (a>)} + j I m { X (of) } in the Hermitian symmetry prop- 
erty, Eq. (5.37), yields 

Re{X(-«)} + j ImfX (-<«)} = Re{X(m)} - j Im{X(<w)}. 

Separating the real and imaginary components in the above expression proves 
the alternative form I of the Hermitian symmetry property. 


5.4. 1.3 Alternative form II for Hermitian symmetry property 

The magnitude spectrum |2f(tu)| of the CTFT X (o>) of a real-valued signal x(t ) 
is even, while its phase spectrum <X(a>) is odd. Mathematically, 


\X(-w)\ = | *(<0)1 and <X(-co) = -<X(-(o). 


(5.39) 
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Proof 

The magnitude of the complex function X(—co) — Re{ X(—o>)\ + j Im{X(— &>)} 
is given by 

l*(-a>)l = V(Re {^(-«)}) 2 + (Im{X(-«)}) 2 . 

Substituting Re{A(— co)} = Re{X(a>)} and Im{A(— a>)} = — Im{X(tt>)}, 
obtained from the alternative form I of the Hermitian symmetry property in 
the above expression, yields 


which proves that the magnitude spectrum |X(a>)| of a real- valued signal is 
even. Alternatively, consider the phase of the complex function X(— co) = 
Re{A(— «)} + j Im{X(— w)} as given by 


Substituting Re{A(— co)} — Re{X(a>)} and Im{A(— co)} = — Im{X(o>)} yields 


which proves that the phase spectrum <X(o>) of a real-valued signal is odd. 

Example 5.11 

Consider a function g(t ) whose CTFT is given by G(a>) = 1 + 2jt8(co — coq). 
Determine if g(t) is a real-valued function. 

Solution 

Substituting co by —co in the CTFT G(co) yields 

G(—co) — 1 + 2 tt8(—co — coq) — 1 + 2 n8{co + coq). 

The complex conjugate of G(co) is given by 

G*(a>) = [1 + 2 jt8(co — a > o )]* = 1 + 2 jt8(co — a > o ). 

Comparing the two expressions, it is clear that G*{co) ^ G(— co), and therefore 
that g(t ) is not a real-valued function. In order to verify the result, we calculate 
the inverse CTFT of G(co) as follows: 

g(t) = ar'jGCtw)} = »- 1 {l+27r5(® - ® 0 )} = _ «„)}, 

which results in 


\X(-co)\ = V(Re{A(«)}) 2 + (-Im{X(«)}) 2 = |X(o>)|, 




g(t) = m + e™', 


or 


g(t) = 8(t) + cos(o*oO + j sm(co 0 t), 
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verifying that g(t) is indeed not real-valued. In deriving the inverse CTFT of 
G(&>), we have assumed that the CTFT satisfies the linearity property, which is 
formally proved in Section 5.5. 


5.4.2 CTFT of real-valued even and odd functions 


A second set of symmetry properties is obtained if we assume that, in addition 
to being real-valued, x(t) is an even or odd function. Before expressing these 
properties, we show that the expression of the CTFT is simplified considerably 
if we assume that x(t) is an even or odd function. 

Using the Euler identity, the CTFT is expressed as follows: 


X(co) = 


oo 

J x{t)t~^'dt = 


OO 

J x(t) cos(cot)dt — j 


OO 

J x(t) sin(a>r)dr. 


— OO 


— OO 


— OO 


Case I If x(t) is even, then x(t) cos (cot) is also an even function, while x(t) 
sin(ttif) is an odd function. Therefore, the CTFT for the even-valued function 
can alternatively be calculated from 

OO 

X(a>)= 2 f x(t)cos(oot)dt. (5.40) 

o 


Case II If x(t) is odd, then.v(f) sin(&>r) is an even function, while x(t) cos (cot) 
is an odd function. An alternative expression for the CTFT for the odd-valued 
function is given by 


X{co) = 


OO 



x(t) sin(®t)dr. 


(5.41) 


By combining the Hermitian property withEqs. (5.40) and (5.41), the following 
two properties are obtained. 


Property 5.1 CTFT of real-valued, even functions The CTFT X(co) of a real- 
valued, even function x{t) is also real and even. In other words, Re{ X (a>)} = 
Re{X(-«)} and Im{A(<w)} = 0. 


Property 5.2 CTFT of real-valued, odd functions The CTFT X(a>) of a real- 
valued, odd function x(t) is imaginary and odd. In other words, Re{ X((o) \ — 
0 and Im{AXtt>)} = — Im{A(— <w)}. 

The proofs of Properties 5.1 and 5.2 are left as exercises for the readers. See 
Problems 5.6 and 5.7. The symmetry properties of the CTFT are summarized 
in Table 5.4. 
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(a) (b) 


Fig. 5 . 9 . CT signals used in 
Example 5 . 12 . (a) Xi( 0 ; 
(b)jr 2 (f). 


Example 5.12 

Calculate the Fourier transform of the functions x\ (t) and x 2 (t) shown in 
Fig. 5.9. 


Solution 

(a) The mathematical expression for the CT function X\ (/), illustrated in 
Fig. 5.9(a), is given by 


x\ (t) = 



-1 < t < 1 

1 <|f| <2 
elsewhere. 


Since X\(t) is an even function, its CTFT is calculated using Eq. (5.40) as 
follows: 


OO 

■f- 


1 

■f 


Xi(a>) = 2 / x(t) cos(a>r)df = 2 / (2r) cos(®f ) dt + 2 / 2cos(&>f)df 


Z 

f 


which simplifies to 


sin(wt) cos(ftjt) 
t h 1 \ — 


l 


sin(mf) 


-i 2 


Xxico) = 4 


CO 

OO 1 

- 0 

CO 

- 1 

sin(cu) cos(o>) 

1 

+ 4 

sin(2tt>) 

sin(«) 

2 

CO co~ 

CO 2 

CO 

CO 


— —[ol> sin(2a>) + cos(a>) — 1]. 
co l 


(5.42) 


The above result validates the symmetry property for real-valued, even func- 
tions. Property 5.1 states that the CTFT of a real-valued, even function is real 
and even. This is indeed the case for X \ (o>) in Eq. (5.42). 

(b) The function X 2 (t), shown in Fig. 5.9(b), is expressed as follows: 


x 2 (t) = 


-2 —2 < f < 1 

It - 1 < t < 1 
2 1 < t < 2 

0 elsewhere. 
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Since x 2 (?) is an odd function, its CTFT, based on Eq. (5.41), is given by 

OO 1 2 

X 2 (co) = —)2 ! x(J) sin(ft)f)df = — j2 J (2t) sin(&>r)dt — j2 J 2sin(&)r)df, 


which simplifies to 

X 2 (a>) = — j4 


cos (cot) sin(ft)t) 
-t — + 1 =— 


-J4 


Jo 


cos(air) 


J 1 


*2(«)=j4 


cos(o>) sin(a>) 


+ J4 


cos(2a>) cos(a>) 


co 


co 


= j— r [&>cos(2a>) — sin(to)]. 


(5.43) 


The above result validates the symmetry property for real-valued odd functions. 
Property 5.2 states that the CTFT of a real-valued odd function is imaginary 
and odd. This is indeed the case for X 2 (t v) in Eq. (5.43). 


5.5 Properties of the CTFT 


In Section 5.4, we covered the symmetry properties of the CTFT. In this section, 
we present the properties of the CTFT based on the transformations of the 
signals. Given the CTFT of a CT function x(t), we are interested in calculating 
the CTFT of a function produced by a linear operation on x(t) in the time 
domain. The linear operations being considered include superposition, time 
shifting, scaling, differentiation and integration. We also consider some basic 
non-linear operations like multiplication of two CT signals, convolution in the 
time and frequency domain, and Parseval’s relationship. A list of the CTFT 
properties is included in Table 5.4. 


5.5.1 Linearity 

Often we are interested in calculating the CTFT of a signal that is a linear 
combination of several elementary functions whose CTFTs are known. In such 
a scenario, we use the linearity property to show that the overall CTFT is 
given by the same linear combination of the individual CTFTs used in the time 
domain. The linearity property is defined below. 

Ifxi(t) and x 2 (t) are two CT signals with the following CTFT pairs: 

. . CTFT „ , x 
X\(t) < > Xi (co) 


and 


CTFT 


X 2 (t) * 


> X 2 (co) 
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Table 5.4. Symmetry and transformation properties of the CTFT 



Time domain 

Frequency domain 


Transformation 

OO 

x(t) = — f X(m)e.' M dm 
2n J 

— OO 

OO 

r 


properties 

X(m) = / x(r)e" J<Bt dr 

— OO 

Comments 

Linearity 

a\Xi(t) + a 2 x 2 (t) 

aiXi(ai) + 02 X 2(01 ) 

Cl\ , CI2 G C 

Scaling 

x(at ) 

1 /01\ 
M X («) 

0 G Df, real-valued 

Time shifting 

x(t - ? 0 ) 

e" J “' 0 Z(w) 

to e SR, real-valued 

Frequency shifting 

e j£ "o'jt(f) 

X(a> — a>o) 

01 0 e SR, real- valued 

Time differentiation 

d"jt 

dt" 

Qai) n X(co) 

provided dx/d? exists 

Time integration 

J x(r)dr 

X(co) 

+ nX(0)S(ai) 
ja> 

provided J x(r)dr 




exists 

Frequency differentiation 

t n x(t) 

d n X 

(j)" 

J; dm" 

provided 6X1 dm exists 

Duality 

X(t) 

2: tx(-oi) 

CTFT 

if x(t) < > X(co) 

Time convolution 

Xi (t)*x 2 (t) 

Xi( co)X 2 (co) 

convolution in time 




domain 

Frequency convolution 

Xi (0 X X 2 {t) 

^- 1 x^( 0 ) *x 2 m 

2tc 

multiplication in time 



domain 

ParsevaTs relationship 

E x = f \x(t)\ 2 dt 

/ i X(w) i 2d&j 

energy in a signal 


— OO 

— OO 


Symmetry properties 



CTFT: X(-ai) = X*(co) 
real and imaginary components 

real component is even; 



1 RejX(o))} = Re{X(-tu)} 

imaginary component 

Flermitian property 

x(t) is a real- valued 
function 

{ ImfXfto)} = — Im{X(— «)} 
magnitude and phase spectra 

is odd 

magnitude spectrum is 



I |X(-®)| = |X(m)| 

even; phase spectrum 



( <X(-ai) = -<X(oi) 

is odd 

Even function 

x(t) is even 

X(a>) = 2 1 x(t) cos(oit)dt 

simplified CTFT 



J 

0 

expression for even 




signals 

Odd function 

x(t) is odd 

X(a>) = — j2 / x(t) sin(ai?)dr 

simplified CTFT 



J 

0 

expression for odd 
signals 

Real- valued and even 

x(t) is even and real- valued 

Re{X(ru)} = Re{X(-c;)} 

CTFT is real-valued and 

function 


Im{X(w)} = 0 

even 

Real- valued and odd 

x(t) is odd and real- valued 

Re{X(w)} = 0 

CTFT is imaginary and 

function 


Im{X(w)} = — Im{X(— w)} 

odd 
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then, for any arbitrary constants a \ and a 2 , the linearity property states that 
CTFT 

a\X\(t) + a 2 X 2 (t) < > a\Xi{w) + 02 X 2 ( 00 ), fora\,a 2 &C, (5.44) 

where C denotes the set of complex numbers. 


Proof 

By Eq. (5.10), the CTFT of the linear combination a\X\{t) and 02 X 2(0 is given 
by 


H{aiXi(t) + a 2 x 2 (t)} 


OO 

J [fliA-i(/) + a2-V2(0]e" J “'dr 

— OO 


OO 

= a 'i 






X 2 (a>) 


or 


3{ttiXi(0 + a 2 x 2 (t)} = aiXi(co) + a 2 X 2 (co), 
which completes the proof. 

The application of the linearity property is demonstrated through the following 
example. 


Example 5.13 

Using the CTFT pairs given in Eqs. (5.25) and (5.27), 
e j “ 0 ' < CTFT > 2jt8(a> - two) 

and 

e -m,r < ( 27 tS(co + coo), 
calculate the CTFT of the cosine function cos(twoO- 


Solution 

Using Euler’s formula, 


3{cos(two01 





^3{e j<00 ') + ^3{e" j " of }. 


Using the aforementioned CTFT pairs for exp(jtwoO and exp(— jtwof ), we obtain 
Js{cos(tuo01 = jt[8(co — two) + S(tw + two)], 
which is the same as the CTFT for the periodic cosine function in Table 5.2. 
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Fig. 5.10. Waveform g(t) used 
in Example 5.14. 



Example 5.14 

Calculate the CTFT of the waveform g(t ) plotted in Fig. 5.10. 


Solution 

By inspection, the waveform g(t) can be expressed as a linear combination of 
x\(t) and X2 (f) from Fig. 5.9, as follows: 

1 

gif) = -[Xiit) + X 2 (t)l 

Using the linearity property, the CTFT of g(t) is given by 
G(w)=^X 1 (w)+^X 2 (co). 


Based on Eqs. (5.42) and (5.43), the CTFT pairs for Xi(t) and x 2 (t) are given 
by 

4 

Xi(a>) — [cl> sin(2&>) + cos(cu) — 1] 

(O 1 


and 


X 2 (co ) = j — [a) cos(2tti) — sin(tti)]. 

CO 2 


The CTFT of g(t) is therefore given by 


G(tt>) = — [u> sin(2w) + cos(«) — 1] + j — \co cos(2tt>) — sin(ai)] 


co 
2 

= — U«e-J 2 “ 

CD 1 


(D- 


a -J« _ 


i]. 


5.5.2 Time scaling 

In Section 1 .4. 1 , we showed that the time-scaled version of a signal x(t) is given 
by x(at). If a > 1, the signal compresses in time. If a < 1, the signal expands in 
time. The time-scaling property expresses the CTFT of the time-scaled signal 
x(at ) in terms of the CTFT of the original signal x(t). 

CTFT 

Ifx(t) » X(co) then 

CTFT 1 / CO \ 

x(at) < > — X ( — ) , for a e 31 and a/0, 

\a\ Vo/ 

where 91 denotes the set of real values. 


(5.45) 
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Fig. 5.11. Waveform h{t) used 
in Example 5.15. 



Proof 

Equation (5.45) can be proved separately for the two cases a > 0 and a < 0. 
Case I (a > 0). By Eq. (5.10), the CTFT of the time-scaled signal x(at) is given 
by 

OO 

3{x(o/)} = J x(at)e~ ico 'dt. 

— OO 

Substituting r = at, the above integral reduces to 

OO 

%{x(at)} = f x(t )e - j" T/2 — = - X (— ) , 

J a a \a / 

— OO 

which proves Eq. (5.45) for a > 0. The proof for a < 0 follows the above 
procedure and is left as an exercise for the reader (see Problem 5.13). 


Example 5.15 

To illustrate the usefulness of the time-scaling property, let us calculate the 
CTFT of the function h{t) shown in Fig. 5.11. 


Solution 

By inspection, the waveform h(t) can be expressed as a scaled version of g(t) 
illustrated in Fig. 5.10 as follows: 

3 /A 3 


Applying the linearity and time-scaling properties with a — 0.5, the CTFT of 
g(t) is given by 


//(«) = 


3 

2 



= 3G(2a>). 


Based on the result of Example 5.14, G(co) = (2/u> 2 )[j&>e J 2 ® + e j® — 1], 
which yields 

H(a>) = 3-A.[j(2«)e-j 2(2 “ ) + e^ 2 ®) - 1] = ^[j2we~^ + e^® - 1], 
(2 co) z 2co z 
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5.5.3 Time shifting 

The time-shifting operation delays or advances the reference signal in time. 
Given a signal x(t). the time-shifted signal is given by xit — to). If the value of 
the shift to is positive, the reference signal x{t) is delayed and shifted towards 
the right-hand side of the /-axis. On the other hand, if the value of the shift to is 
negative, signal xit) advances forward and is shifted towards the left-hand side 
of the /-axis. 

CTFT 

If x(t) A * X(a>) then 

CTFT 

g(t) = x(t - t 0 ) for to e ill, (5.46) 

where 91 denotes the set of real values. 

Proof 

By Eq. (5.10), the CTFT of the time-shifted signal x(t — to) is given by 

OO 

3{jc(/ - t 0 )} = J x(t - / 0 )e~ J£or d/ 

— OO 

OO 

= e~ j “ f0 J x(r)e _jl0T dr by substituting r = (/ - t 0 ) 

— OO 

= e- j 10,0 X(w), 

which proves the time-shifting property, Eq. (5.46). 

The CTFT time-shifting property states that if a signal is shifted by to time 
units in the time domain, the CTFT of the original signal is modified by a 
multiplicative factor of exp(— )<x>ot). The magnitude and phase of the CTFT of 
the time-shifted signal g(t) = x(t — to) are given by 

magnitude |G(a>)| = |e“ j "'°A r (w)| = |e“ j ® f0 ||A'(a;)| = |X(w)|; (5.47) 

phase <G(a>) = <{e- io, ' 0 X(co)} = <e- j “'°+ <X(co) = -a>t 0 + <X(co). 

(5.48) 

Based on Eqs. (5.47) and (5.48), we can conclude that the time shifting does not 
change the magnitude spectrum of the original signal, while the phase spectrum 
is modified by an additive factor of — coto- 

In Example 5.16, we illustrate the application of the time-shifting property 
by calculating the CTFT of the waveform illustrated in Fig. 5.12. 

Example 5.16 

Express the CTFT of the function fit) shown in Fig. 5. 12 in terms of the CTFT 
of g(t) shown in Fig. 5.10. 
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Fig. 5.12. Waveform f(t) used in 
Example 5.16. 



Solution 

By inspection, /(f) can be expressed in terms of g(t) as 


fit) = -g 


t + 3 


;g 


We calculate the CTFT of each term in /(f) separately. By considering the 
CTFT 

CTFT pair g(t ) < > G(o>) and applying the time-shifting property with 

a — 3, we obtain 


g 



CTFT 

* > 3G(3tw). 


Using the time-shifting property, 

, (1+2) ^3^0(3 „> and s ^ 3e^-G(3n, ) . 


Finally, by applying the linearity property, we obtain 

h (^r) + 5 s (tt) ^ \ ■ 3e,! " G(3 “ ) + i ■ 3e ' i7 " G ( 3 “»- 


Expressed in terms of the CTFT of g(t), the CTFT F(co) of the function /(f) is 
therefore given by 

F(w) = ^e j3w G(3«) + ^e- j7 “G(3rw). 


5.5.4 Frequency shifting 

In the time-shifting property, we observed the change in the CTFT when a signal 
x(t) is shifted in the time domain. The frequency-shifting property addresses 
the converse problem of how a signal x(t ) is modified in the time domain if its 
CTFT is shifted in the frequency domain. 

CTFT 

Ifx(t) < > X(co) then 

CTFT 

h(t) = e, i<O0 'x(t) ^ > X(co - two), for w 0 e 3i, (5.49) 

where 91 denotes the set of real values. 

The frequency-shifting property can be proved directly from Eq. (5.10) by 
considering the CTFT of the signal exp(j&>of )x(t). The proof is left as an exercise 
for the reader (see Problem 5.15). 
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By calculating the magnitude and phase of the term exp(ja>oO-*(0 on the 
left-hand side of the CTFT pair shown in Eq. (5.49), we obtain 

magnitude \h{t)\ = \e icoot x{t)\ = |e j<B0 '||*(OI = \x{t)\\ (5.50) 

phase <h(t) — <e j “ 0 'jc(f) = <ei" 0 ' + <x(t) = u> 0 t + <x(t). (5.51) 

In other words, frequency shifting the CTFT of a signal does not change the 
amplitude |jc(f)| of the signal x(t) in the time domain. The only change is in the 
phase <x(t) of the signal x(t), which is modified by an additive factor of coot. 

Example 5.17 

In Section 2. 1 .3, we considered an amplitude modulator used in the AM band of 
the radio transmission to transmit an information signal m(t) to the receiver. In 
terms of the information signal m(t), the amplitude-modulated signal is given 
by 


s(t) = A[1 + km(t)] cos(&>of). 

Express the CTFT of the amplitude-modulated signal s(t) in terms of the CTFT 
M(a>) of the information signal m(t). 


Solution 

The amplitude-modulated signal is a sum of two terms: A cos(a>ot) and Akm(t) 
cos (coot). In Example 5.13, we calculated the CTFT of the A cos(o>o?) as 

CTFT 

A cos(o>oO < > An[8((o — a>o) + <5(<w + a>o)]- 


By expanding cos(cuof), the second term Akm(t) cos(&>o0 is expressed as fol- 
lows: 

Akm(t) cos(tt>oO = -Akm(t)[^‘°° , + e^" 0 ']. 

By using the frequency-shifting property, the CTFT of the terms m(t) exp(jo>oO 
and m(t) exp(— jwoO are given by 

< CTFT ) . M(co — a>o) and < CTFT > M(a> + co o). 


By using the linearity property, the CTFT of Akm(t) cos(cuo0 is th en given by 


CTFT 

Akm(t)cos(a>ot) < -Ak[M{co — coq) + M{co + a>o)]. 

By adding the CTFTs of the two terms, the CTFT of the amplitude-modulated 
signal is given by 


, . CTFT , 
s(t) < A 


k k 

ttS(ci) — a>o) + jt8(o) + too) + - M(to — a>o) + -M(co + too) 
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5.5.5 Time differentiation 

The time-differentiation property expresses the CTFT of a time-differentiated 
signal dx/dr in terms of the CTFT of the original signal x(t). We state the 
time-differentiation property next. 

CTFT 

Ifx(t) < - > X(m) then 

dx CTFT 

— < > j mX(m) (5.52) 

dr 

provided the derivative dx/dr exists at all time t. 


Proof 

From the CTFT synthesis equation, Eq. (5.9), we have 

OO 

x(t) = — [ X(m)& iW ' dm. 

In J 

— OO 

Taking the derivative with respect to t on both sides of the equation yields 

. 1 . 


dx d 
dt ~ dr 


— f X(m)e iw 'dm 
2 TV J 




Interchanging the order of differentiation and integration, we obtain 


dx 

~dt 


OO OO 

= i/ X(w) ^ {ej<u,}d<w= i J 


Comparing this with Eq. (5.9), we obtain 


dx CTFT 

— > j coX{m). 


Corollary By repeatedly applying the time differentiation property, it is 
straightforward to verify that 


d"x 

dr" 


CTFT 

^ > (j m) n X{m). 


Example 5.18 

In Example 5.1 1, we showed that the CTFT for the periodic cosine function is 
given by 

CTFT 

cos(w 0 r) < > 7r[<5(a> — m 0 ) + S(m + &> 0 )]. 

Using the above CTFT pair, derive the CTFT for the periodic sine function 
sin(a>or). 
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Solution 

Taking the derivative of the CTFT pair for the cosine function yields 
d CTFT 

— {COS(<y 0 0} < > (]bO)TT[&(a> - W o) + 8(cO + (Wo)]. 

dr 

By rearranging terms, we obtain 
CTFT 

— a>o sin (&) of ) < > )tc[(il)q8(oo — a > o ) — coq8(u> + &> o )], 


which can be expressed as follows: 

coq sin(&)or) < > — [a>o8{a> — coq) — coq8(co + &>o)L 

j 


obtained by using the multiplicative property of the impulse function, 
x(t)8(t + to) = x(—to)S(t + to). The CTFT of the periodic sine function is 
therefore given by 

CTFT n 

sin(&>oO < > — [8{cl> — a>o) — 8(co + cuo)]. 

J 


5.5.6 Time integration 

The time-integration property expresses the CTFT of a time-integrated signal 
/ x(t)dt in terms of the CTFT of the original signal x(t). 


CTFT 

Ifx(t) 4 » X(co), then 

t 

/ CTFT X (a>) 

x(r)dr < - - > — — + 7tX(0)5(oj). 

j CO 

— OO 


(5.53) 


The proof of the time-integration property is left as an exercise for the reader 
(see Problem 5.14). 


Example 5.19 

CTFT 

Given 8(t) < > 1, calculate the CTFT of the unit step function u(t ) using 

the time-integration property. 

Solution 

Integrating the CTFT pair for the unit impulse function yields 

t 

/ C TFT 

S(t)dt +=■ > — + jt8(cl>). 

— OO 

By noting that the left-hand side of the aforementioned CTFT pair represents 
the unit step function, we obtain 

CTPT 

u{t) < > — + n8(co). 

j<r> 

The above CTFT pair can be verified from Table 5.2. 
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5.5.7 Duality 

The CTFTs of a constant signal x(t) = 1 and of an impulse function x(t) = S(t) 

are given by the following CTFT pairs (see Table 5.2): 

and 

CTFT . CTFT . 

1 4 > 2 tt8(co) and S(t ) 4 > 1. 

For the above examples, the CTFT exhibits symmetry across the time and 
frequency domains in the sense that the CTFT of a constant x (t) = 1 is an impulse 
function, while the CTFT of an impulse function x(t ) = S(t) is a constant. This 
symmetry extends to the CTFT of any arbitrary signal and is referred to as the 
duality property. We formally define the duality property below. 

CTFT 

Ifx(t) 4 ^ » X(co), then 

CTFT 

X(t ) 4 -= ► 2ttx(-co) (5.54) 


is also a CTFT pair. 

Proof 

By the definition of the inverse CTFT, Eq. (5.9), we know that 

OO 

*(0=2^ f *(/V'd/', 

— OO 

where the dummy variable r is used instead of a>. Substituting t = —w in the 
above equation yields 

CO 

2itx(-co) = J X(r)e ~ i0)r dr = %{X(t)}. 

— OO 

To illustrate the application of the duality property, consider the CTFT pair 


with x(t ) = 5 (t) and X(co) — I . By interchanging the role of the independent 
variables t and a>, we obtain X(t) = 1 and x(o>) = Using the duality 
property, the converse CTFT pair is given by 
CTFT 

1 4 ^ 4 2ttS(-co) = 2i t8(co), 

which is indeed the CTFT of the constant signal x(t) = 1. 


Example 5.20 

As stated in Eq. (5.22), the following is a CTFT pair (see Example 5.6): 


rect 



CTFT 

4 > r sine 
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Calculate the CTFT of x{t) = (IV /jt) sine (IV t/n) using the duality property. 


Solution 

By interchanging the role of variables t and co in the following CTFT pair: 

( t \ CTFT / cox \ 

- j < » r sinc^— J = X(co), 

we obtain X{t ) — x six\c(tx /2tz) and x(—co) = rect(— a>/x). Using the duality 
property, we obtain 


. f tx\ CTFT J~“>\ 

r sine I - — I < > 2 it rect| | . 


Substituting r = 2 IV and dividing both sides of the above equation by 2jt yields 


W ( IV t \ CTFT / ft) \ 
— sine — I < > rect . 


it 


V2 W > 


The above result was proved in Example 5.7 by deriving it directly from the 
definition of the CTFT. 


5.5.8 Convolution 


In Section 3 .4, we showed that the output response of an LTIC system is obtained 
by convolving the input signal with the impulse response of the system. At times, 
the resulting convolution integral is difficult to solve analytically in the time 
domain. The convolution property provides us with an alternative approach, 
based on the CTFT, of calculating the output response. Below we define the con- 
volution property and explain its application in calculating the output response 
of an LTIC system. 

CTFT CTFT 

Ifxii t) > Xiico) and x 2 (t) » X 2 (co), then 

CTFT 

Xi(t) * x 2 {t) ^ > Xi (o>)X 2 (a>) (5.55) 


and 


Xi (0*2(0 ^-[Xi(fti) * X 2 (w)]. (5.56) 

Ltz 

In other words, convolution between two signals in the time domain is equivalent 
to the multiplication of the CTFTs of the two signals in the frequency domain. 
Conversely, convolution in frequency domain is equivalent to multiplication of 
the inverse CTFTs in the time domain. In the case of the frequency-domain 
convolution, one has to be careful in including a normalizing factor of 1/2jt. 
We prove the convolution property next. 
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Proof 

To prove Eq. (5.55), consider the CTFT of the convolved signal [x\(t) * x 2 (f)]. 
By the definition in Eq. (5.9), 

OO 

£5{jci(f) * x 2 it)} = J {xi(0 * x 2 (r)}e _jiu 'dt. 

— OO 

Substituting the convolution [x\(t) * X 2 (r)] by its integral, we obtain 


OO OO 


3{xi(r)*x 2 (/)} 


-f / 

— oo — OO 


x l (r)x2 (t — r)dr 




By changing the order of the two integrations, we obtain 


OO OC 

= I X ' M I 


»{xi(t)*x 2 (f)} = / xi(r) 


where the inner integral is given by 


x 2 (t - r)e- ja "d t 


dr, 


OO 

/ 


x 2 (t — r)e j“"d t = Ss{x 2 (f — r)} = X 2 (a>)e i0lz . 


Therefore, 


/ 


t{xi (t) * x 2 (t)} = X 2 (co) / *i(r)e- J “ T dr = X 2 {co)X l {co). 


The convolution property, Eq. (5.56), in the frequency domain can be proved 
similarly by taking the inverse CTFT of [X\ (co) * X 2 (w)] and following the 
aforementioned procedure. 

Equation (5.55) provides us with an alternative method to calculate the convo- 
lution integral using the CTFT. Expressed in terms of the CTFT pairs 

CTFT CTFT CTFT 

x(t) < > X(co), h(t) < - - > //(«), and y(t) < > T(«), 

the output signal y(t) is expressed in terms of the impulse response h(t) and 
the input signal x(t) as follows: 

CTFT 

y (t) = x(t) * hit ) < - > Y (o>) = X(a))H(co), 


obtained by applying the convolution property in the time domain. In other 
words, the CTFT of the output signal is obtained by multiplying the CTFTs 
of the input signal and the impulse response. The procedure for evaluating the 
output yit) of an LTIC system in the frequency domain, therefore, consists of 
the following four steps. 
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(1) Calculate the CTFT X(to ) of the input signal x(t). 

(2) Calculate the CTFT H (to ) of the impulse response h(t) of the LTIC system. 
The CTFT H(co) is referred to as the transfer function of the LTIC system. 

(3) Based on the convolution property, the CTFT Y (to) of the output y(t) is 
given by Y (a>) = X(co)H(co). 

(4) Calculate the output y(t) by taking the inverse CTFT of Y (to) obtained in 
step (3). 

The CTFT-based approach is convenient for three reasons. First, in most cases 
we can use Table 5.2 to look up the expression of the CTFTs and their inverses. 
In such cases, the CTFT-based approach is simpler to use than the time-domain 
approach based on the convolution integral. In cases where the CTFTs are 
difficult to evaluate analytically, they are obtained by using fast computational 
techniques for calculating the Fourier transform. The CTFT-based approach, 
therefore, allows the use of digital computers to calculate the output. Finally, the 
CTFT-based approach provides us with a meaningful insight into the behavior of 
many systems. An LTIC system is typically designed in the frequency domain. 

Example 5.21 

In Example 3.6, we showed that in response to the input signal x(t) — er'u(t), the 
LTIC system with the impulse response h(t) = e -'u(t ) produces the following 
output: 


y(t) = (e~' - e~ 2 ‘)u(t). 


We will verify the above result using the CTFT-based approach. 


Solution 

Based on Table 5.2, the CTFTs for the input signal and the impulse response 
are as follows: 


. . CTFT 1 
e u(t) < y 


-t / S wivl * _2t . , CTFT 1 

v and e u(t) < > 


1 + jco 2 + j to 

The CTFT of the output signal is therefore calculated as follows: 

Y(to) = S{[e”' M (f)] * e[ _2, i((t)]} = »{e“ r «(t)} x S{e~ 2r w(f)}. 
Using the CTFT pair 

CTFT 1 


e~ a u(t) ^ ► 


a + }to 


we obtain 


1 1 

x 


1 + ju) 2 + j®’ 


Y(co) = 
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which can be expressed in terms of the following partial fraction expansion: 


Y(co) = 


1 1 

1 + j co 2+ jco 


Taking the inverse CTFT yields 


y(t) = (e ' - e 2, )u(t) 


which is identical to the result obtained in Example 3.6 by direct convolution. 


5.5.9 Parseval's energy theorem 

Parseval’s theorem relates the energy of a signal in the time domain to the 
energy of its CTFT in the frequency domain. It shows that the CTFT is a 
lossless transform as there is no loss of energy if a signal is transformed by the 
CTFT. 


For an energy signal x(t), the following relationship holds true: 


E x = J \x{t)\ 2 dt=j- j \X{a>)\ 2 dw. 


(5.57) 


Proof 

To prove the Parseval’s theorem, consider 


OO 

J \X(co)\ 2 dco 

— OO 


OO 

J X(co)X*(co)dco. 

— OO 


Substituting for the CTFT X (o>) using the definition in Eq. (5.10) yields 


OO 

J \X(co)\ 2 da> = 


OO 


OO 



jc(a)e '““da 


— OO 


— OO 


OO 


OO 

J x(f)e~ iu,p df 

_^-oo 


dco, 


where we have used the dummy variables a and fi to differentiate between the 
two CTFT integrals. Taking the conjugate of the third integral and rearranging 
the order of integration, we obtain 


OO OO OO OO 

J \X(co)\ 2 dw= J x(a) J x*(f ) J 


d/3 da. 


Based on Eq. (5.15), we know that 


OO 

J e MP-<*)d a> — 2 tc8(/3 — a), 

— OO 
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which reduces the earlier expression to 


OO 

J \X((jo)\ 2 dco = 2 it 



OO 

J x*(P)8(/3 -a)dpdci 


— OO 


— OO — OO 


or 


**(«) 


E x 


I \x(a)\ 2 da =i- J \X(co)\ 2 dco. 


— OO 


— OO 


Example 5.22 

Calculate the energy of the CT signal x (?) = e~ a 'u(t) in the (a) time and 
(b) frequency domains. Verify that Eq. (5.57) is valid by comparing the two 
answers. 


Solution 

(a) The energy in the time domain is obtained by 


OO OC 

E x = J \x(t)\ 2 dt = J e“ 2a 'd t = 


—2 at r 


a — 2 at 


—2a 


l 

2 a 


(b) From Table 5.2, the CTFT of x(t) — e u(t) is given by 


e a, u(t) 4 


CTFT 


1 


a + j&> 

The energy in the frequency domain is therefore given by 


OO OO 

£, = T/m»,Pd«,= T|_i 


1 

-dw— — 

+ C0 2 2 TT 


-tan 1 
a \a / 


By comparison, the results in (a) and (b) are the same. 


1 

2 a 


5.6 Existence of the CTFT 

The CTFT X (co) of a function x(t) is said to exist if 

\X(a))\ < oo for — oo < a) < oo. (5.58) 

The above definition for the existence of the CTFT agrees with our intuition 
that the amplitude of a valid function should be finite for all values of the 
independent variable. A simpler condition in the time domain can be derived 
by considering the inverse CTFT of X (co) as 

OO 

J x(t)&-^'dt . 


|X(«)| = 
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Applying the triangle inequality in the CT domain, we obtain 

OO OO OO 

l*(®)l< J \x(t)e~^\dt = j \x{t)\\^ w, W = J |x(r)|dr, 

— OO — OO — OO 

which leads to the following condition for the existence of the CTFT. 

Condition for existence of CTFT The Fourier CTFT X(a>) of a function x(t) 
exists if 

OO 

j |jc(r)|dr < oo. (5.59) 

— OO 

Equation (5.59) is a sufficient condition to verify the existence of the CTFT. 

Example 5.23 

Determine if the CTFTs exist for the following functions: 

(i) causal decaying exponential function f(t) = exp(— at)u(t); 

(ii) exponential function g(t) = exp (—at); 

(iii) periodic cosine waveform h{t) = cos(a>oO> 

where a, co o e 9t + . 


Solution 

(i) Equation (5.59) yields 


OO OO OO OO 

J \f(t)\dt = J \e~ ar u(t)\dt = J e~ at u(t)dt = J e~ a, d t 


0 

= — [e-°']“ = - < oo. 

—a a 

Therefore, the CTFT exists for the causal decaying exponential function, 
(ii) Equation (5.59) yields 

OO OO oo 0 oo 

J |g(0|df= J |e _flf |dr = J e~ ar dt = J e~ al dt + J s~ at dt = oo. 


—oo =l/a 

Therefore, the CTFT does not exist for the exponential function, 
(iii) Equation (5.59) reduces to 


OO OC 

j \h(t)\dt= J 


\h(t)\dt = |cos(® 0 ? )|d ? = oo- 


Therefore, the CTFT does not exist for the exponential function. 
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In part (iii), we proved that the CTFT does not exist for a periodic cosine 
function. This appears to be in violation of Table 5.2, which lists the following 
CTFT pair for the periodic cosine function: 


Actually, the two statements do not contradict each other. The condition for the 
existence of the CTFT assumes that the CTFT must be finite for all values of 
u>. The above CTFT pairs indicate that the CTFT of the periodic cosine func- 
tion consists of two impulses at a> = ±&>o. From the definition of the impulses, 
we know that the magnitudes of the two impulse functions in the aforemen- 
tioned CTFT pair are infinite at a> — ±<y o, and therefore that the periodic cosine 
function violates the condition for the existence of the CTFT. 

In Section 5.7, we show that the CTFTs of most periodic signals are derived 
from the CTFS representation of such signals, not directly from the CTFT 
definition. Therefore, we make an exception for periodic signals and ignore the 
condition of CTFT existence for periodic signals. 


Consider a periodic function x(t) with a fundamental period of Tq. Using the 
exponential CTFS, the frequency representation of x{t) is obtained from the 
following expression: 


where coq — 2n / Tq is the fundamental frequency of the periodic signal and D„ 
denotes the exponential CTFS coefficients D „ , given by 



5.7 CTFT of periodic functions 


oo 



(5.60) 


n — — oo 



(5.61) 


Calculating the CTFT of both sides of Eq. (5.60), we obtain 



Using the linearity property, the above expression is simplified to 


OO OO 


X(a>)= D n %{ei n<00 '} = 2it D„8(co-nw 0 ). 


In other words, the CTFT of a periodic function x(t) is given by 



(5.62) 


Yl — — OO 
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(a) 


1 .. 
3 In 



-1 In 


(b) 


Fig. 5.13. Alternative 
representations for the periodic 
function considered in Example 
5.24. (a) A periodic rectangular 
wavefunction q(t), (b) CTFS 
coefficients D„ for q(t), and 
(c) the CTFT Q(a>)otq(t). 


?(0 

3 


-2k -k 0 k 2k 
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Vk 
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A 
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3/5 k 

. t . 


->« 


6/5 


-6 -4 1-2 

-2 


Q(a>) 


tt 4 

-2 


6/5 


► O) 


(C) 


Equation (5.62) provides us with an alternative method for calculating the CTFT 
of periodic signals using the exponential CTFS. We illustrate the procedure in 
Examples 5.24 and 5.25. 

Example 5.24 

Calculate the CTFT representation of the periodic waveform q(t) shown in 
Fig. 5.13(a). 


Solution 

The waveform q(t) is a special case of the rectangular wave x(t) considered in 
Example 4.14 with r = n and T — 2n . Mathematically, 


qit) — 3 x(t) with duty cycle t/T — 1/2. 

Using Eq. (4.49), the CTFS coefficients of s(t ) are given by 

3 /n\ 

o„ = r ,nc (-) 


or 


^ 3 . /n\ 

D -=i s,nc (i)= 


3 

2 

0 


n — 0 

n =2k=£0 

1 


— n — 4 k ■ 
rut 
3 

n = 4k + 3 . 

njr 

Substituting &>o = 1 in Eq. (5.62) results in the following expression for the 
CTFT: 


<7(0 « 


CTFT 


2 jt D„8(a> — n). 
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jl-5 D n 


fin 

▲ H(m) 


► n 


-6-4-2 0 


2 4 6 


-8 co 0 -6a> 0 -4co 0 -2o) 0 0 


-jl-5 


-> 0 ) 


2co 0 4co 0 6 co 0 8co 0 




(a) 


(b) 


Fig. 5.14. Alternative 
representations for the sine 
wave considered in Example 
5.25. (a) CTFS coefficients Q, ; 
(b) CTFT representation H(u>). 


The CTFS coefficients D„ and the CTFT Q(o>) of the periodic rectangular wave 
are plotted in Figs. 5.13(b) and (c). 

Example 5.25 

Calculate the CTFT for the periodic sine wave h(t) = 3 sinloJoO- 


Solution 

To obtain the CTFS representation of the periodic sine wave, we expand sin(cuot) 
using Euler’s identity. The resulting expression is as follows: 

3 

h(t) = 3 sin(ft> 0 r) = — [e ia>0 ‘ - e“ J ®°'], 

2j 


which yields the following values for the exponential CTFS coefficients: 


D 


n 


— jl-5 n = I 
jl-5 n — — 1 
0 otherwise. 


Based on Eq. (5.62), the CTFT of a periodic sine wave is given by 

OO 

H(oj) — 2jt D„8(a> — na>o) = )37t[8(cl> + wo) — 8(a> — a>o)]- 

ft — — OO 


The CTFS coefficients and the CTFT for a periodic sine wave are plotted in Fig. 
5.14. The above result is the same as derived in Example 5.18, with a scaling 
factor of 3. 


5.8 CTFS coefficients as samples of CTFT 


In Section 5.7, we presented a method of calculating the CTFT of a periodic 
signal from the CTFS representation. In this section, we solve the converse 
problem of calculating the CTFS coefficients from the CTFT. 

Consider a time-limited aperiodic function x(t), whose CTFT X (to) is known. 
By following the procedure used in Section 5. 1 , we construct several repetitions 
of x(t) uniformly spaced from each other with a duration of Tq. The process is 
illustrated in Fig. 5.1, where x(t) is the aperiodic signal plotted in Fig. 5.1(a). Its 
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periodic extension Xr(t) is shown in Fig. 5.1(b). Using Eq. (5.3), the exponential 
CTFS coefficients of the periodic extension are given by 

To/2 

D„ = — f x(t)e-i" m ' dt = — f x(t)eT inm ‘ dt . 

To J T 0 J 

(To) -To/2 

Since x r{t) = x(t) within the range —To < t < Tq, the above expression 
reduces to 

Jo/2 oo 

D„ = j x(t)e~i na>0 'dt = 1 j x(t)e~i na>ot dt = ^X(w) L =n(Bo , (5.63) 

-To/2 -oo 

which is the relationship between the CTFT of the aperiodic signal x{t) and the 
CTFS coefficients of its periodic extension xj (/). In other words, we can derive 
the exponential CTFS coefficients of a periodic signal with period To from the 
CTFT using the following steps. 


(1) Compute the CTFT X(a>) of the aperiodic signal .v(r) obtained from one 
period of Xr(t) as 


x(t) = 


x T it) 

0 


-T 0 /2 < t < To/2 
elsewhere. 


(2) The exponential CTFS coefficients D n of the periodic signal Xj it) are given 
by 


T2 n — ... X (u>) | cj =n(O0 , 

Jo 


where coo denotes the fundamental frequency of the periodic signal Xrit) 
and is given by a>o = 2jt /Tq. 


Example 5.26 

Calculate the exponential CTFS coefficients of the periodic signal xj it) shown 
in Fig. 5.13(a). 


Solution 


Step 1 The aperiodic signal representing one period of Xr(t) is given by 


xit) = 3 rect ( — ) . 


Using Table 5.2, the CTFT of the rectangular gate function is given by 


. t \ CTFT . / a>\ 

3 rect | — I < > 3tc sine y — J . 
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Step 2 The exponential CTFS coefficients D n of the periodic signal Xr(t) are 
obtained from Eq. (5.63) as 
1 

D n = —X («)!„=„«„ with T 0 = 2jt and &> 0 = 1. 

1 o 

The above expression simplifies to 


3 /n 

\ 3 • / 

/ nit \ 

- sine - 

■ ) = — sin 

— 

2 V 2 

/ nn ' 

v 2 / 


5.9 LTIC systems analysis using CTFT 


In Chapters 2 and 3, we showed that an LTIC system can be modeled either 
by a linear, constant-coefficient differential equation or by its impulse response 
h(t). A third representation for an LTIC system is obtained by taking the CTFT 
of the impulse response: 

h(t) < > H(co). 

The CTFT // (o>) is referred to as the Fourier transfer function of the LTIC 
system and provides meaningful insights into the behavior of the system. The 
impulse response relates the output response y(t ) of an LTIC system to its input 
x(t) using 

y(t) = h(t) * x(t). 

Calculating the CTFT of both sides of the equation, we obtain 

Y(w) = H(w)X(fi>), (5.64) 

where Y (o>) and X (co) are the respective CTFTs of the output response y(t) and 
the input signal x(t). Equation (5.64) provides an alternative definition for the 
transfer function as the ratio of the CTFT of the output response and the CTFT 
of the input signal. Mathematically, the transfer function 1 1 (o>) is given by 

Y(oj) 

H(co)=^-X (5.65) 

X(oj) 


5.9.1 Transfer function of an LTIC system 


It was mentioned in Section 3.1 that, for an LTIC system, the relationship 
between the applied input x(t) and output y(t) can be described using a constant- 
coefficient differential equation of the following form: 


n 


Y. ak 


d k x 
d t k 


m 




d k x 

df' 


(5.66) 


From the time-differentiation property of the CTFT, we know that 


d"jr CTFT 

< - -> (j co) n X{cS). 

dr" J 
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Calculating the CTFT of both sides of Eq. (5.66) and applying the time- 
differentiation property, we obtain 

n m 

a k 0ctfY(a>) = b k (]u) k X(co) 


H(u>) = 


Y{co) 

X(co) 


^2 h k(i° J ') k 

k = 0 

m 

k = 0 


(5.67) 


Given one representation for an LT1C system, it is straightforward to derive 
the remaining two representations based on the CTFT and its properties. We 
illustrate the procedure through the following examples. 


Example 5.27 

Consider an LTIC system whose input-output relationship is modeled by the 
following third-order differential equation: 

d 3 y d 2 y dy Ax 

TT+ 6 TT + i^+6y(t) = 2 — + 3x(t). (5.68) 

dr J dr*- dr dr 

Calculate the transfer function H(a > ) and the impulse response h(t) for the LTIC 
system. 


Solution 

Using the time-differentiation property for the CTFT, we know that 


d"x 

At" 


CTFT 

< » (3a>rX(a>). 


Taking the CTFT of both sides of Eq. (5.47) and applying the time- 
differentiation property yields 


(» 3 T(a>) + 6(j co) 2 Y(co) + ll(j®)T((w) + 6 Y(co) = 2(j co)X(w) + 3 X{w). 


Making Y (co) common on the left-hand side of the above expression, we obtain 
[(j«) 3 + 6(j«) 2 + ll(j«) + 6 ]F(«) = [2(j co) + 3 ]X(o>). 


Based on Eq. (5.46), the transfer function is therefore given by 


H(co) = 


Y (co) 
X(a>) 


2(j co) + 3 

(j<w) 3 + 6(j®) 2 + 1 l(jco) + 6 ' 


(5.69) 


The impulse response h(t) is obtained by taking the inverse CTFT of Eq. (5.69). 
Factorizing the denominator, Eq. (5.69) is expressed as 


H{(o) = 


2(ja>) + 3 

(1 +ja>)(2+jw)(3 + jw)’ 
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which, by partial fraction expansion, reduces to 

1 1 3 

H(w) = + . 

2(1 + jro) (2 + j&>) 2(3 + joi) 

Taking the inverse CTFT: 

h{t) = Qe- f + e~ 2 ' - ^~Au(t). (5.70) 

Equations (5.68)-(5.70) provide three equivalent representations of the LTIC 
system. 


Example 5.28 

Consider an LTIC system with the following impulse response function: 


h{t) — rect 



1 |f|<r/2 

0 |f| > r/2. 


(5.71) 


Calculate the transfer function Him) and the input-output relationship for the 
LTIC system. 


Solution 

Lrom Table 5.2, we obtain the following transfer function: 



2 • / 

'COT \ 

r sine — 

= — sin 

— 

\2jt / 

CO ' 

^ 2 / 


In other words, 

Yim) 2 / ®r\ 

= — sin — , 

Xim) m V 2 / 

which is expressed as 

]U>Y (a)) = j2sin (^pjXio)) 


or 


j wYim) = e ia,z/2 Xim) - e~ icot/2 Xico). 


Taking the inverse CTLT of both sides, we obtain 


d y 
dr 




(5.72) 


5.9.2 Response of LTIC systems to periodic signals 

In Section 4.7.2, we derived the output response of an LTIC system, shown in 
Lig. 5.15, of the following periodic signal: 

OO 

xit)= D n e ina>0 ' 

n=—oo 


(5.73) 
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x(t) 



y( t) 


periodic LTIC periodic 

input system output 


Fig. 5.15. Response of an LTIC 
system to a periodic input. 


as 


CO 

y(t)= J2 Dn ^ nmt H{co)\ w=nwo , (5.74) 

n = — oo 

where H(co) is the CTFT of the impulse response h(t) of the system and is 
referred to as the transfer function of the LTIC system. Corollary 4.1 is a 
special case of Eq. (5.74), where the input is a sinusoidal signal and the impulse 
response h{t) is real-valued. In such cases, the output y(t) can be expressed as 
follows: 


k\ exp(ja>oO -> A\k\ exp(j<y 0 t + j0i), (5.75) 


A'i sin(&>oO -> A\k\ sin(a>of + <P\), (5.76) 

and 

k\ cos(mo0 —*■ A\k\ cos(a>o t + </>i), (5.77) 

where A i and <p\ are the magnitude and phase of H(a>) evaluated at a> = o>o . 

Equations (5.73)-(5.77) can be derived directly by using the CTFT. We now 
prove Eq. (5.74). 

Proof 

The CTFT of a periodic signal x(t ) is given by 

x(t) < CTFT > 2jt D n 8(co — na>o). 

n= — oo 

Using the convolution property, the output of an LTIC with transfer function 
H(co) is given by 

OO OO 

Y(cd) — 2jt ^2 D n 8(w — na>o)H(co) = 2n ^ D,,8(a> — ncoo)H(ncoo). 

n=—oo n=— oo 

Taking the inverse CTFT of the above equation yields 

OO OO 

y(t) = ^2 Dn% l {27T8(a> — na>o)}H(ncoo) = ^ D n H(ncoo)e inoiot , 

n=—o o n=—o o 

which proves Eq. (5.74). 


Example 5.29 

Consider an LTIC system with impulse response given by 


10 


not 


h(t ) = — sine I 

n V 


7 r 


(5.78) 
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(a) 


1 

H( m) = 

rect ( 20 ) 




► 


(b) 


Fig. 5.16. LTIC system sketched as a function of time t in Fig. 5.16(a). Determine the output response 

considered in Example 5.29. 0 f t| le system for the following inputs: 

(a) Impulse response h(t); 

(b) transfer function H(w). (i) x\(t) = sin(5f); 

(ii) X 2 {t) = sin(15f); 

(iii) .* 3 (t) = sin(8f) + sin(20f). 

Solution 

Calculating the CTFT of Eq. (5.78), the transfer function H{co) is given by 

//(©) = reel (5.79) 

The magnitude spectrum of the LTIC system is plotted in Fig. 5.16(b). The 
phase of the LTIC system is zero for all frequencies. 

(i) Input x\ (t) = sin(5f). The CTFT of the input signal x\(t) is given by 

*i(<u) = -[5(<w-5)-S(cw + 5)]. 

J 

The CTFT Yi (co) of the output signal is obtained by multiplying X \ (o>) by // (o>) 
and is given by 

Yi(a > ) = X\(co)H(w) = —S(co — 5 )//(«) 8(co + 5 )H(co). 

J J 

Using the multiplication property of the impulse function, we have 
Yi(w) = —S(co - 5)H (5) - -8(a> + 5)H(-5). 

j j 

Since H(± 5) = 1, the CTFT Yi(a>) of the output signal is given by 

Ti(w) = -8(a - 5) - -8(o) - 5). 

J J 

Taking the inverse CTFT, the output is given by 

yi(r) = sin(5r). 

The CTFT Li (cu) of the output signal can also be obtained by graphical multipli- 
cation, as shown in Fig. 5.17(a), where the magnitude spectrum of the transfer 
function H(co) is shown as a dashed line. Since the magnitude of the transfer 
function H(a > ) is one at the location of the two impulses contained in the CTFT 
of the input signal, the CTFT Y\(oo) of the output signal is identical to the CTFT 
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Fig. 5.17. Frequency 
interpretation of the output 
response of an LTIC system. 
Response of the LTIC system 
(transfer function shown 
as a dashed line) to: 

(a) x,(f) = sin(5f); 

(b) x 2 (f) = sin(15f); 

(c) x 3 (f) = sin(8f) + sin(20f). 
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(c) 


of the input signal. By calculating the inverse CTFT, we obtain the output as 

y\{t) = xi it) = sin(5f). 

(ii) Input x 2 (t) — si n( 1 5f). The CTFT of the input signal %2 (t) is given by 

X 2 (co) = -[<$(« - 15) - 8(0, + 15)]. 

J 

The CTFT Y 2 (oo) of the output signal is obtained by multiplying X t (o>) by 1 1 (o>) 
and is given by 

Y 2 (co) = Xo(co)H(co) = —8(co - 15 )H(co) - -8(oo + 15)// (cu). 

j j 

Using the multiplication property of the impulse function, we have 

TjO) = Xi (co)H(o) = -8(co - 15)//(15) - -8(a> + 15)//(— 15). 

J J 

Since H(± 5) = 0, the CTFT Y\(o>) of the output signal is given by 


Ti(cu) = 0. 

Taking the inverse CTFT, the output is y 2 (t) = 0. 

As in part (i), the CTFT Y 2 (oj) of the output signal can be obtained by 
graphical multiplication shown in Fig. 5.17(b). Since the magnitude of the 
transfer function H(co) is zero at the location of the two impulses contained in 
the CTFT of the input signal, the two impulses are blocked from the output of 
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the LTIC system. The CTFT Y\(a > ) of the output signal is zero, which results in 
yi(t) = 0. 

(iii) Input x 3 (t) = sin(8r) + sin(20f)- Taking the CTFT of the input x 3 (t) 
yields 

X 3 (co) = -[8(a) - 8) - 8(co + 8)] + -[<5(« - 20) - 8(co ± 20)]. 

j j 


By following the procedure used in part (i), the CTFT Y 3 (oS) of the output signal 
is given by 


r 3 (©) = 


-8(a) - 8)//(8) - -8(w ± 8)//(— 8) 
.J J 


-8(0) - 20 )// ( 20 ) - -8(a) + 20 )//(— 20 ) 

L j j 


The input signal consists of four impulse functions with two impulses located 
at a) = ±8 and two located at o> = ±20. The magnitude of the transfer function 
at frequencies co = ±8 is one, therefore the two impulse functions 8(co - 8) and 
8(a> ± 8) are unaffected. The magnitude of the transfer function at frequencies 
o) — ±20 is zero, therefore the two impulses 8(a> - 20) and S(a> ± 20) are 
eliminated from the output. The CTFT of the output signal therefore consists 
of only two impulse functions located at (co = ±8), and is given by 


Y 3 (co) = 


-8(o)-S)--8(o) + %) , 

J j 


which has the inverse CTFT of 


y 3 (t) = sin(8f). 

In signal processing, the LTIC system with h(t) = (lO/zr) sinc(10t/7r) is 
referred to as an ideal low-pass filter since it eliminates high-frequency com- 
ponents and leaves the low-frequency components unaffected. In this example, 
all input frequency components with frequencies greater than a> > 10 are elim- 
inated. Any input components with lower frequencies (co < 10) appear unaf- 
fected in the output of the LTIC system. The frequency (co = 10) is referred to 
as the cutoff frequency of the ideal low-pass filter. 


5.9.3 Response of an LTIC system to quasi-periodic signals 

The response of an LTIC system to ideal periodic signals is given by Eqs. 
(5.73)— (5.77). In practice, however, it is difficult to produce ideal periodic 
signals of infinite duration. Most practical signals start at t = 0 and are of finite 
duration. In this section, we calculate the output of an LTIC system for input 
signals that are not completely periodic. We refer to such signals as quasi- 
periodic signals. 
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R= 1 M£2 


| VA 

f 

Y x(t) = sin(3/) 


9 

r v 

C=0.5 pF 
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Example 5.30 

Consider the RC series circuit shown in Fig. 5.18. Determine the overall and 
steady state values of the output of the RC series circuit if the input signal is 
given by x(t) = sin(3?)w(f). Assume that the capacitor is uncharged at t = 0. 


Fig. 5.18. RC series circuit 
considered in Example 5.30. 


Solution 

The CTFT of the input signal x(t) is given by 

X(co) = J[«(a > - 3) - 8(o) + 3)] + — ^ 
2j 9 — or 


From the theory of electrical circuits, the transfer function of the RC series 
circuit is given by 


H(co) = 


1/jag 
/? + 1 /j o)C 


1 

1 -T j coC R 


Substituting the value of the product CR = 0.5 yields 


H(co) = 


1 

1 + j0.5&> 


By multiplying the CTFT of the input signal by the transfer function, the CTFT 
of the output y(t ) is given by 


Y(co) = %[8(w - 3) - 8(a) + 3)] + 

2j 9 — or 


1 

1 +j0.5w 


Solving the above expression results in the following: 


Y(o)) = 


jt 8(o) — 3) 

2j L l+jl-5 


8(o) + 3) 3 

1 — j 1 -5 J + (9 — o) 2 )( \ +j0.5<w)' 


Taking the inverse CTFT of the above expression (see Problem 5.10) yields the 
following value for the output signal: 


y(t) = 


2 

yi3 


sin(3r - 56 °)u(t) 

V ^ 


steady state value 



transient value 


An alternative way of obtaining the steady state value of the output of the RC 
series circuit is suggested in Corollary 4.1. Expressed in terms of the given 
input, Corollary 4. 1 states 


sin(3r) u(t) — > A i sin(3f + </>i) u(t ) , 

jc (0 y(f) 

where A \ and <p\ are, respectively, the magnitude and phase of the transfer 
function at o) = 3. The values of Ai and (p\ are given by 


Ai = \H(3)\ = 


1 


cp x = <H( 3) = < 


1 + j0.5(3) 
1 


1 + j0.5(3) 


2 

— == and 

713 

= -tan-'a.S) = -56°. 
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Substituting the values of A\ and (j)\ in Corollary 4.1, the steady state value of 
the output is given by 


y ss (t ) = 


2 

713 


sin(3r - 56°MO. 


For sinusoidal signals, Corollary 4. 1 provides a simpler approach of determining 
the steady state output. 


5.9.4 Gain and phase responses 

The Fourier transfer function //(&>) provides a complete description of the 
LTIC system. In many applications, the graphical plots of \H{w)\ and < //(«) 
versus frequency a> are used to analyze the characteristics of the LTIC system. 
The magnitude spectrum \H(co)\ response function is also referred to as the 
gain response of the system, while the phase spectrum <H(a>) is referred to as 
the phase response of the system. Below, we provide an example to illustrate 
the procedure involved in plotting the magnitude and phase spectra. We also 
introduce Bode plots, where a logarithmic scale is used for the frequency oj-axis. 

Example 5.31 

Consider an LTIC system with the impulse response h(t) = 1 ,25e 06( 
sin(0.8f)t/(7). Plot the gain and phase responses of the LTIC system. 

Solution 

The transfer function H(a > ) of the LTIC system is given by 

//(«) = 3{1.25e -0 ' 6f sin(0.8rM0} = 1-25 x 

1 (0.6 + jft>) 2 + 0.8 2 

1 

1 — ft. 2 + j 1.2ft. 

The magnitude and phase spectra are as follows: 

1 

magnitude spectrum \H(a>)\ = 

y/(l — ft) 2 ) 2 + (1.2ft)) 2 

1 

V 1 — 0.56 w 2 + cu 4 
phase spectrum <//(&>) = — tan 

Figure 5.19(a) plots the magnitude spectrum and Fig. 5.19(b) plots the phase 
spectrum of the LTIC system. Figure 5.19(a) illustrates that the magnitude 
| //(ft)) | = 1 for w = 0. As the frequency a> increases, the magnitude \H(a>)\ 
drops and approaches zero at very high frequencies. From Fig. 5.19(b), we 
observe that the phase <// (a>) is zero at o> = 0. At high frequencies, the phase 
<//(&>) converges to —jt radians, or —180°. 
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0123456 0123456 

(a) (b) 

Fig. 5.19. Magnitude and phase spectra of LTIC system with impulse response h(t) = 1.25 
e~° 6t sin(0.8f)u(f). (a) Magnitude spectrum; (b) phase spectrum. 



Fig. 5.20. Bode plots for the 
LTIC system considered in 
Example 5.31. (a) Magnitude 
plot; (b) phase plot. 


Bode plots In Bode plots, the magnitude \H(a>)\ in decibels and phase <H(a > ) 
are plotted as functions of frequency a> using a logarithmic scale. Use of a loga- 
rithmic scale, with base 10, on the frequency co-axis offers two main advantages. 

(1) Compared to a linear scale, the use of a logarithmic scale allows a wider 
range of frequencies to be plotted, with the lower frequencies represented 
at a higher resolution. 

(2) The asymptotic approximations of the magnitude and phase spectra can 
easily be sketched graphically by hand. 


Figure 5.20 illustrates the Bode plots of the LTIC system considered in 
Example 5.31 using a logarithmic scale on the frequency axis. Figure 5.20(a) 
shows the magnitude Bode plot, where the magnitude \H(co)\ is expressed in 
decibels (dB) as 20 logio|//(&>)| and plotted as a function of logio(cn). Figure 
5.20(b) shows the phase Bode plot, where the phase <//(&>) is plotted as a 
function of logio(cn). 


5.10 M atlab exercises 


In this section, we will consider two applications of Mat LAB. First, we 
illustrate the procedure for calculating the CTFT of a CT signal x{t) using 
M ATLAB. In our explanation, we consider an example, x{t) = 4cos(10jrf), 
and write the appropriate M ATLAB commands for the example at each step. 
Second, we list the procedure for plotting the Bode plots in Matlab . 
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5.10.1 CTFT using Matlab 

Step 1 Sampling In order to manipulate the CT signals on a digital computer, 
the CT signals must be discretized. This is normally achieved through a process 
called sampling. In reality, sampling is followed by quantization, but because 
of the high resolution supported by Matlab, we can neglect quantization 
without any appreciable loss of accuracy, at least for our purposes here. Sam- 
pling converts a CT signal x(t ) into an equivalent DT signal x[k}. To prevent 
any loss of information and for x[k] to be an exact representation of x(t), the 
sampling rate co s must be greater than at least twice the maximum frequency 
&>max present in the signal x(t), i.e. 

co s > 2<y max . (5.80) 

This is referred to as the Nyquist criterion. We will consider sampling in depth 
in Chapter 9, but the information presented above is sufficient for the following 
discussion. 

The CTFT of the periodic cosine signal is given by (see Table 5.2) 

CTFT 

4 cos(lOjrt) 4^ » 4 tt [5 (cu — 10 jt) + «5(<w + 10 tt)]; (5.81) 

hence, the maximum frequency in x(t ) is given by <w max — IOjt radians/s. Based 
on the Nyquist criterion, the lower bound for the sampling rate is given by 


co s > 207T radians/s. (5.82) 

We choose a sampling rate that is 20 times the Nyquist rate, i.e. co s = 
400jt radians/s. The sampling interval T s is given by 

T s = — = 5 ms. (5.83) 

co s 

Selecting a time interval from — 1 to 1 second to plot the sinusoidal wave, the 
number N of samples in x[k] is 401. The Matlab command that computes 
x [A'] is therefore given by 


> t = -1:0.005:1; 

> x = 4*cos (10*pi*t) ; 

> subplot (221) ; plot(t,x) 

> subplot (222 ) ; stem(t,x) 


% define time instants 
% samples of cosine wave 
% for CT plot 
% for DT plot 


The subplots are plotted in Fig. 5.21(a) and (b) and provide a fairly accurate 
representation of the cosine wave. 


Step 2 Fast Fourier transform In Matlab, numeric computation of the 
CTFT is performed by using a fast implementation referred to as the fast 
Fourier transform (FFT). At this time, we will simply name the function without 
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Fig. 5.21. Matlab subplots for 
the time and frequency domain 
representations of 
x(t) = 4 cos(lOjrf). (a) CT plot 
forx(f); (b) DT plot for x(f); 

(c) uncompensated CTFT of 4 1); 

(d) CTFT of x(t). 


worrying about its implementation. The function that evaluates FFT is f f t (all 
lower-case letters). The Matlab command for calculating f f t is 

> y = fft(x); % fft computes CTFT 

> subplot (223 ) ; plot (abs (y) ) ; % abs calculates magnitude 

The subplot of y is plotted in Fig. 5.21(c). There are two differences between 
y (output of the fft function) and the CTFT pair, 


CTFT 

4cos(107rr) < - > 4n[S(co- 10:r) + ,5(cw + 10;r)]. 


By looking at the peak value of the magnitude spectrum |y|, we note that the 
magnitude is not given by 4 tt as the CTFT pair suggests. Also, the x-axis 
represents the number of points instead of the appropriate frequency range w. 
In steps (3) and (4), we compensate for these differences without going into 
the details of why the differences occur. The differences between the output of 
fft and CTFT will be discussed in Chapter 11. 


Step 3 Compensation Scale the magnitude of y by multiplying it by ji times 
the sampling rate ( jtT s ). In our example, T s is 5 ms. The following Matlab 
command performs the scaling: 

> z = pi*0.005*y; % scale the magnitude of y 

We also center z about an integer index of zero. This is accomplished by 
f f tshif t . 


> z = f f tshif t (z) ; 


centre the CTFT about w = 0 
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Step 4 Frequency axis For a sequence x[k] of length N with a sampling 
frequency w s , the f f t function y = f f t (x) produces the CTFT of x(t) at N 
equispaced points within the frequency interval [0, w s ]. The resolution A a> in the 
frequency domain is, therefore, given by Aw = co s /(N — 1). After centering, 
performed by the f f tshif t function, the limits of the interval are changed 
to [— w s /2, o>J2\ . The MATLAB commands to compute the appropriate values 
for the w-axis are given by 

> dw = 400* pi/ 400; 

> w = -400* pi/2:dw:400* pi/2; % calculates frequency 

% axis; 

> subplot (224 ) ; plot (w, abs ( z ) ) ; % magnitude spectrum 

The subplot of the CTFT is plotted in Fig. 5.21(d). By inspection, it is confirmed 
that it does correspond to the CTFT pair in Eq. (5.81). 

The phase spectrum of the CTFT can be plotted using the angle function. 
For our example, the Matlab command to plot the angle is given by 


> subplot (224 ) ; plot (w, angle ( z )) ; % phase spectrum 


The above command replaces the magnitude spectrum in subplot (224) 
by the phase spectrum. For the given signal, x(t) = 4 cos( 1 Ott r), the phase 
spectrum is zero for all frequencies co. The Matlab code for calculating the 
CTFT of a cosine wave is provided below in a function called myctf t. 


function [w,z] = myctf t 

% MYCTFT : computes CTFT of 4 *cos ( 10 *pi * t ) 
% Usage: [w,z] = myctft 


compute 4 cos(10*pi*t) in time domain 


A = 4; 
wO = 10*pi; 
ws = 20*w0; 

Ts = 2*pi/ws; 
t = - 1 : Ts : 1 ; 
x = A*cos (w0*t) ; 

% compute the CTFT 
y = fft(x) ; 
z = pi*Ts*y ; 
z = ff tshif t (z) ; 

% compute the frequency axis 
w = - ws/2 : ws/length ( z ): ws/2 -ws/length ( z ) ; 

% plots 

subplot (211) ; plot(t,x) % CT plot of cos(w0*t) 

subplot (212 ); plot (w, abs (z) ) % CTFT plot of cos(w0*t) 


amplitude of cosine wave 
maximum frequency in signal 
sampling rate 
sampling interval 
define time instants 
samples of cosine wave 

fft computes CTFT 
scale the magnitude of y 
centre CTFT about w = 0 


end 
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To calculate the inverse CTFT, we replace the function f f t with i f f t and 
reverse the order of the instructions . The Matlab code to compute the inverse 
CTFT is provided in a second function called myinvctf t: 

function [t,x] = myinvctf t (w, z) 

% MYINVCTFT: computes inverse CTFT of y known at 
% frequencies w 

% Usage: [t,x] = myinvctf t (w, z) 

% compute the inverse CTFT 
x = if f tshif t (z) ; 

x = ifft(x); % inverse fft 

% compute the time instants 

ws = w(length(w)) - w(l); % sampling rate 

Ts = 2*pi/ws; % sampling interval 

t = Ts* [- floor (length (w) ) /2 : floor (length (w) ) /2 - 1] ; 

% amplify signal by 1/ (pi*Ts) % sampling instants 

x = x/Ts; 

% plots 

subplot (211) ; plot (w, abs (z) ) % CTFT plot of cos(w0*t) 

subplot (212 ) ; plot (t, real (x) ) % CT plot of cos(w0*t) 

% end 


5.10.2 Bode plots 


Matlab provides the bode function to sketch the Bode plot. To illustrate the 
application of the bode function, consider the LTIC system of Example 5.31. 
The system transfer function is given by 


H(co) — 1.25 x 


0.8 

(0.6 + jo>) 2 + 0.8 2 


In order to avoid a complex-valued representation, Matlab expresses the 
Fourier transfer function in terms of the Laplace variable s — j co. In Chapter 
6, we will show that the independent variable s represents the entire complex 
plane and leads to the generalization of the Fourier transfer function into an 
alternative transfer function, referred to as the Laplace transfer function. Sub- 
stituting ( s = j co) in // (co) results in the following expression for the transfer 
function: 


ms) = 


1 

(0.6 + s) 2 + 0.8 2 


1 

s 2 + i. 25 + r 


Given H(s), the Bode plots are obtained in Matlab using the following 
instructions: 
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> clear; % clear the Matlab environment 

> num_coeff = [1] ; % coefficients of the numerator 

% in decreasing powers of s 

> denom_coeff =[11.21]; % coefficient of the denominator 

% in decreasing powers of s 

> sys = tf (num_coef f , denom_coef f ) ; 

% specify the transfer function 

> bode (sys, {0 . 01, 100}) ; % sketch the Bode plots 

In the above set of Matlab instructions, we have used two new functions: tf 
and bode. The built-in function tf specifies the LTIC system H(s ) in terms 
of the coefficients of the polynomials of s in the numerator and denominator. 
Since the numerator N(s ) = 1, the coefficients of the numerator are given by 
num_coeff = 1. The denominator D(s) = s 2 + 1 ,2s + I . The coefficients 
of the denominator are given by denom_coef f = [1 1.2 1 ] . 

The built-in function bode sketches the Bode plots. It accepts two input 
arguments. The first input argument sys in used to represent the LTIC system, 
while the second input argument {0.01,100} specifies the frequency range, 
0.01 radians/s to 100 radians/s, used to sketch the Bode plots. In setting the 
values for the frequency range, we use the curly parenthesis. Since the square 
parenthesis [0.01,100] represents only two frequencies, a> = 0.01 and a> = 
100 , it will result in the wrong plots. The second argument is optional. If 
unspecified, Matlab uses a default scheme to determine the frequency range 
for the Bode plots. 


5.11 Summary 


In this chapter, we introduced the frequency representations for CT aperiodic 
signals. These frequency decompositions are referred to as the CTFT, which 
for a signal x(t) is defined by the following two equations: 


CTFT synthesis equation 


CTFT analysis equation 


x(t) = — f X(«)e j “"d to; 
2 TT J 

— oo 
oo 

X(co)= J x(t)e~ i0, 'dt. 


Collectively, the synthesis and analysis equations form the CTFT pair, which 
is denoted by 

, . CTFT w . 
x(t) < > X(co). 

In Section 5.1, we derived the synthesis and analysis equations by expressing 
the CTFT as a limiting case of the CTFS. Several important CTFT pairs were 
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calculated in Section 5.2. The results are listed in Table 5.2, and their magni- 
tude and phase spectra of the CTFT are plotted in Table 5.3. In Section 5.3, 
we presented the partial fraction method for calculating the inverse CTFT. In 
Section 5.4, we covered the following symmetry properties of the CTFT. 

(1) The CTFT X(co) of a real-valued signal x(t) is Hermitian symmetrical, i.e. 
X(co ) = X*(—co). Due to the Hermitian symmetry property, the magnitude 
spectrum \X (cu)| is an even function of co, while the phase spectrum <X(co) 
is an odd function of co. 

(2) The CTFT X(a>) of a real-valued and even signal x(t) is also real-valued 
and even, i.e. Re{2f(<u)} = Re{X(— co)} and Im{2f(tt>)} = 0. 

(3) The CTFT X (co) of a real-valued and odd signal x(t) is also pure imaginary 
and odd, i.e. Re{2f(o>)} = 0 and Im {X(co)} = — Im{2f(— co)}. 

Section 5.5 considered the transformation properties of the CTFT, which are 
summarized as follows. 

(1) The linearity property states that the CTFT of a linear combination of 
aperiodic signals is given by the same linear combination of the CTFT of 
the individual aperiodic signals. 

(2) If an aperiodic signal is time-scaled, the CTFT is inversely time-scaled. 

(3) A time shift of to in the aperiodic signal does not affect the magnitude of 
the CTFT. However, the phase changes by an additive factor of coto- This 
property is referred to as the time-shifting property. 

(4) A frequency shift of co o in the aperiodic signal does not affect the magnitude 
of the signal in the time domain. However, the phase of the signal in the 
time domain changes by an additive factor of coto. This property is referred 
to as the frequency-shifting property. 

(5) The CTFT of a time-differentiated periodic signal is obtained by multiplying 
the CTFT of the original signal by a factor of j co. 

(6) The CTFT of a time-integrated periodic signal is obtained by dividing the 
CTFT of the original signal by a factor of jo> with a scaled impulse function 
at co = 0. 

(7) The duality property states that there is symmetry between the time wave- 
form and its frequency-domain representation such that the two functions 
in a CTFT pair are dual with respect to each other. Given an arbitrary 
time-domain waveform x{t) and its CTFT waveform X(o>), for example, a 
second CTFT pair exists with the time-domain representation X ( t ), having 
the same waveform as X(co), and the CTFT 2: rx(-co) in the frequency 
domain. 

(8) Convolution in the time domain is equivalent to multiplication of the CTFT 
in the frequency domain, and vice versa. The convolution property leads 
to an alternative approach for evaluating the output response of an LTIC 
system to any arbitrary input. 
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(9) The Parseval’s theorem states that the total energy in a function is the same 
in the time and frequency domains. Therefore, the energy in a function can 
be obtained either in the time domain by calculating the energy per unit time 
and integrating it over all time, or in the frequency domain by calculating 
the energy per unit frequency and integrating over all frequencies. 

In Section 5.6 we derived the following condition for the existence of the CTFT 
of the signal.v(t): 

OO 

J \x{t)\At < oo, 

— OO 

while in Sections 5.7 and 5.8 we discussed the relationship between the CTFS 
and CTFT of periodic signals. In particular, the CTFT of a periodic signal x(t ) 
is obtained by the relationship 

x(t) < CTFT > 2tt D n S(co — nco o), 

n =— oo 

where D n denotes the exponential CTFS coefficients and cdq is the fundamental 
frequency. Conversely, the CTFS of a periodic signal is obtained by sampling 
the CTFT of one period of the periodic signal at frequencies co = ucl>q. Section 
5.9 showed that the three representations (linear, constant-coefficient differen- 
tial equation; impulse response; and transfer function) for LTIC systems are 
equivalent. Given one representation, it is straightforward to derive the remain- 
ing two representations based on the CTFT and its properties. The transfer 
function 1 1 (o>) plays an important role in the analysis of LTIC systems, and is 
typically the preferred model for representing LTIC systems. In Section 5.10, 
we concluded the chapter by showing the steps involved in computing the CTFT 
of a CT signal using Matlab. 


Problems 


5.1 For each of the following CT functions, calculate the expression for the 
CTFT directly by using Eq. (5.10). Compare the CTFT with the corre- 
sponding entry in Table 5.2 to confirm the validity of your result. 

(a) XiA(^) = (1 - \t\/T)[u(t + r) - u(t - r)]; 

(b) X 2 (t) — t 4 e~ a ‘u(t), with a e 9I + ; 

(c) X3 (t) — e _£ " cos(co 0 t)u(t), with a, wq e 9t + ; 

(d) x 4 (t) = e,-’ 2 l 2a \ with cr e m. 

5.2 Calculate the CTFT of the functions shown in Figs. P5.2 (a)-(e). 

5.3 Three functions x\(t), X2U), and x 4 U) have an identical magnitude 
spectrum |X(&>)| but different phase spectra denoted, respectively, by 
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Fig. P5.2. Aperiodic signals for 

Problem 5.2. (e) 


<X\(a>), <X 2 (<w), and <X 2 (co): magnitude and phase plots are shown 
in Figs. P5.3(a)-(d). By representing the CTFTs as X p (co) — \ X{co) 
| exp(j <X„(a>)), for p — 1,2, and 3, and calculating the inverse CTFT, 
determine the functions Xi(f), * 2 ( 0 , and x 3 (?). 


5.4 Using the partial fraction method, calculate the inverse Fourier transform 
of the following functions: 

(1 +j®) 


(a) X i (oj) = 

(b) X 2 (co) = 

(c) X 3 (co) = 

(d) X 4 (co) = 

(e) X 5 (w) = 


(2 + ja>)(3 + jru) ' 

2 -]co 

(1 + jrw)(2 + jrw)(3 + j&>) ’ 

2 — jet) 

(1 +jo;)(2+j&>) 2 (3+jftj)’ 
1 

(1 +jcu)(2 + 2j« + (j cu) 2 )’ 

1 

(1 + jcu) 2 (2 + 2]co + (j®) 2 ) 


2\2 ‘ 
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Fig. P5.J. Amplitude and phase 


W®)l 


spectra of the three functions in 



Problem 5.3. 

1 






w 


-wow 


(a) 



(b) 




5.5 Prove the following identity: 

OO 

J e j “'d t = 2 nS(co). 

— OO 

[Hint: Show that the integral on the left-hand side is a generalized function 
that satisfies Eq. (1.47) presented in Chapter 1.] 

5.6 Show that the CTFT X (of) of a real-valued even function x(t) is also real and 
even. In other words, that Re{X(tt>)} = Re{X(— &>)} and \m{X(o))\ = 0. 


5.7 Show that the CTFT X(co) of a real-valued odd function x(t) is imag- 
inary and odd. In other words, that Re{7f(a>)} = 0 and I m { X (of ) | = 
-Im{X(— «)}. 


5.8 Using the Hermitian property, determine if the time-domain functions cor- 
responding to following CTFTs are real- valued or complex- valued. If a 
time-domain function is real-valued, determine if it has even or odd sym- 
metry. 


(a) Xi(a>) = — 77 1 

2 + j(co — 5) 

(b) X 2 (a>) = cos ^2 co + — 


(c) X 3 (co) = 


_ 5 sin[4(a> — 7r)] , 


(CO — 7r) 


(d) X A (co) = (3 + j2)<5(® - 10) + (1 - j2)5(© + 10); 


1 

(e) X 5 (w) = 2 — 2 V 

(1 +jw)(3 +jw) 2 (5 + ar) 
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Fig. P5.12. CT signal for 
Problem 5.12. 



5.9 Using Table 5.2 and the properties of the CTFT, calculate the CTFT of 
the following functions: 

(a) x\(t) = 5 + 3 cos(lOr) — 7e -2 ' sin(3r)t<(r); 

(b) * 2 (0 = — ; 

7 rt 

(c) x 3 (0 = r 2 e -4|f-51 ; 

( d ) * 4 (0 = 5 sin(37rf) 2 sin(57rf) ; 


sin(37rr) d 

(e) * 4 (0 = 4 * — 

t dr 


sin(4;rr) 

t 


5.10 Using Table 5.2 and the linearity property, show that the CTFT of the 
function 


x(t) = 



6 

13 


cos(3r) + 


4 

— sin(3r) 


u(t ) 


is given by 

X(M) = (9 — &> 2 )(2 + j&>) 

- ^[(3 + j2)5(r» - 3) + (3 — j2)<5(a> + 3)]. 

5.11 Prove the following time-scaling property (see Eq. (5.45)) of the CTFT: 
CTFT 1 / CO \ 

x(at ) > —X ( - ) , for a e 91 and a ^ 0. 

\a\ \a/ 


5.12 Using the time-scaling property and the results in Example 5.12, calculate 
the CTFT of the function /?(f) shown in Fig. P5.12. 

5.13 Prove the following frequency- shifting property (see Eq. (5.49)) of the 
CTFT: 

h(t) = e j “° r *(r) < CTFT > X{oo - &> 0 ), for co 0 e 31. 

5.14 Prove the following time-integration property (see Eq. (5.53)) of the 
CTFT: 

t 

/ CTFT X(a)) 

x(r)dr < - > —— + jtX(0)S(co). 

j O) 
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CTFT 

5.15 Assume that for the CTFT pair x(t ) < > X (o>), the CTFT is given by 

the triangular function 


X(o>) = A (|) 



0 


N<3 

elsewhere. 


Using the CTFT properties (listed in Table 5.4), derive the CTFT for the 
following set of functions: 

(a) e~j 5 ',r(2t); (d) x 2 (t)-, 

(b) t 2 x(t)\ (e) x(t) * x(t); 

(c) (f + 5)4p (f) cos(a>ot)x(t) with o>o = 3/2, 3, and 6. 

5.16 Using the transform pairs in Table 5.2 and the properties of the CTFT, 
calculate the inverse Fourier transform of the functions in Problem 5.8. 


5.17 For each of the following functions, (i) draw a rough sketch of the function, 
and (ii) determine if the CTFT exists by evaluating Eq. (5.59): 

(a) x\ (r) = e -a|f| , with a £ 9i + ; 

(b) X 2 (t) — s~ al cos(o>o/)m( 0> with a, o>o £ 9i + ; 

(c) X 3 (t) = t 4 e~ a, u(t), with a e 9f + ; 

(d) x\ (f) = sin(ln(t))«(f); 

1 

(e) x 5 (t) = -■ 

(f) x 6 (t) = cos(^) ; 

(g) XtQ) = e ‘ ^ 2or2 , with a £ ill. 

5.18 Using the exponential CTFS representations (calculated in Problem 4.11), 
calculate the CTFT for the periodic signals shown in Fig. P4.6. 

5.19 Determine the CTFS coefficients for the periodic functions shown in Fig. 
P4.6 from the CTFTs calculated in Problem 5.2. 


5.20 Determine (i) the transfer function, and (ii) the impulse response for the 
LTIC systems whose input-output relationships are represented by the 
following linear, constant-coefficient differential equations. Assume zero 
initial conditions in each case. 

d 3 y d 2 y dy 

(a) df + 6 d^ + n i +6y(t)=x(t) - 

d 2 y dy 

tt + 3 t- + 2 ^ = x W- 

dr 2 dr 

d 2 y dy 

(C) -4 + 2— + y(r) = x(f). 
dr 2 dr 


(d) 


d 2 y 

dr 2 



+ 8y(r) = 


dx 

dt 


+ 4x (r ) . 


(e) ^4 


d 3 y 

dr 1 


d 2 y dy 

+ 19— + 12y(t) = x(t). 
dr 2 dr 
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Fig. P5.22. (a) RC circuit 
system; (b) input signal. 



Fig. P5.23. RC circuit with 
sinusoidal input signal 
considered in Problem 5.23. 


R 




5.21 Consider the LTIC systems with the following input-output pairs: 

(a) x(t) = e~ 2, u(t) and y(t) = 5 e~ 2t u(t); 

(b) x(t) = e~ 2t u(t) and y{t) = 3 s~ 2(, ~ 4) u(t - 4); 

(c) x (t) = e~ 2l u(t ) and y(t) = t 3 e -2 ' w(f); 

(d) x(t) = e~ 2l u(t) and y(t) = e~‘u(t ) + e~ 3, u(t). 

For each of the above systems, determine (i) the transfer function, (ii) the 
impulse response function, and (iii) the input-output relationship using 
linear constant-coefficient differential equations. 

5.22 Determine the transfer function of the system shown in Fig. P5. 22(a). 
Calculate the output of the system for the input signal shown in Fig. 
P5. 22(b). 

5.23 Using the convolution property of the CTFT, calculate the output of the 
system shown in Fig. P5.23 for the input signals (i) X\( 1 ) = cos(o> {) t), and 
(ii) x 2 (t) = sin(&>oO- 

5.24 Sketch the gain and phase responses for the LTIC systems in 

Problem 5.20. 

5.25 Sketch the gain and phase responses for the LTIC systems in 

Problem 5.21. 
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5.26 Show that if the transfer function H (o>) of a system is Hermitian symmetric 
(i.e. its impulse response h(t) is real-valued), the outputs of the system to 
cosine and sine inputs are as follows: 

Hermitian Symmetric H(co) 

cos(mof) > |//(mo)l cos(tt>of + <H(a>o )) 

and 

Hermitian Symmetric H(co) 

sin(&>oO > |//(ct>o)l sin(®ot + <H(a> o)). 

5.27 Using the results in Problem 5.26, verify the answers in Problem 5.23. 

5.28 Using the results derived in Section 5.9.2 and the linearity property of 
the CTFT, calculate the output of the system shown in Fig. P5.23 for the 
following input signals. Assume that R = 1 M£2 and C = 0.1 /rF. 

(i) Xi (t) = sin(3t); 

(ii) %2 (t) = cos(3 1 ) — 5 sin( 6 1 + 30°); 

(iii) Xi(t) = cos(2r) + sin(2000f); 

(iv) X 4 (t) = e-i 3 ' + eJ 2000 '. 

5.29 Suppose the CT signal 

x(t) = z~'u(t) 


is applied as input to a causal LTIC system modeled by the impulse 
response 

h(t) = eT 1 ' u(t) 


Calculate the resulting output y(t) using: 

(a) direct convolution; 

(b) transfer function //(«); 

(c) differential equation. 


5.30 The periodic signals shown in Figs. P4.6(a)-(e) are applied to the follow- 
ing LTIC systems: 


(i) Hi(co) 


in) H 2 ((o) = 


1 \co\<- 

0 elsewhere; 

4 8 

1 - < |£ 0 | < - 

0 elsewhere. 


Sketch the magnitude and phase spectra of the CTFT of the resulting 
outputs. 


5.31 The transfer function of two LTIC systems are given by 
20 — j w 
(i) H x {fo) = J ■ 


(ii) H 2 (co) = 


20 jru 
1 \co\ > 20 
0 elsewhere. 
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(a) By sketching the magnitude spectrum of each of the LTIC systems, 
comment on the frequency properties of the two systems. Classify 
the two systems as a lowpass, highpass, bandpass, or an allpass fil- 
ter. Recall that a lowpass filter blocks high-frequency components; a 
highpass filter blocks low-frequency components; a bandpass filters 
blocks frequency components within a certain band of frequencies; 
while an allpass filters allows all frequency components to be passed 
on to the output. 

(b) Determine the impulse response for each of the two LTIC systems. 

5.32 Sketch the gain and phase responses for the three LTIC systems given 
below: 

(a) h\(t) = 2ter'u(ty, 

(b) h 2 (t) = u(t ); 

(c) /73(f) = -2,5(0 + 5e~ 2t u(t). 

For each of the three systems, show that the input signal x(t ) = cos / 
produces the same output response. How can this result be explained? 

5.33 (Matlab exercise) By making modifications to the myctf t function 
listed in Section 5.10, sketch the magnitude and phase spectra of the 
following signals: 

(i) Xi (t) = sin(57rf) for —2 < t < 2 with sampling rate co s = 200? r 
samples/s; 

(ii) x 2 (t) = sin(87 rf) + sin(20jrf) for —1.25 < t < 1.25 with sampling 
rate co s = 10007T samples/s. 

5.34 (Matlab exercise) Compute the CTFTs of the CT functions specified 
in Problem 5.1. By plotting the magnitude and phase spectra, compare 
your computed result with the analytical expressions listed in Tables 5.2 
and 5.3. 

5.35 (Matlab exercise) Compute the output response y (t ) for Problem 5.29 
by computing the CTFT for x(t) and h{t), multiplying the CTFTs and 
then taking the inverse CTFT of the result. 

5.36 (Matlab exercise) Sketch the magnitude and phase Bode plots for the 
LTIC systems specified in Problems 5.20 and 5.21. 


CHAPTER 



Laplace transform 


In Chapters 4 and 5, we introduced the continuous-time Fourier series (CTFS) 
for CT periodic signals and the continuous-time Fourier transform (CTFT) 
for both CT periodic and aperiodic signals. These frequency representations 
provide a useful tool for determining the output of an LTIC system. Unfortu- 
nately, the CTFT is not defined for all aperiodic signals. In cases where the 
CTFT does not exist, an alternative procedure, based on the Laplace trans- 
form , is used to analyze the LTIC systems. Even for the CT signals for which 
the CTFT exists, the Laplace transforms are always real-valued, rational func- 
tions of the independent variable 5 provided that the CT functions are real. The 
CTFTs are complex-valued in most cases. Therefore, using the Laplace trans- 
form simplifies algebraic manipulations and leads to important flow diagram 
representations of the CT systems from which the hardware implementations 
of the CT systems are derived. Finally, the CTFT can only be applied to stable 
LTIC systems for which the impulse response is absolutely integrable. Since 
the Laplace transform exists for both stable and unstable LTIC systems, it can 
be used to analyze a broader range of LTIC systems. 

The difference between the CTFT and the Laplace transform lies in the choice 
of the basis functions used in the two representations. The CTFT expands an 
aperiodic signal as a linear combination of complex exponential functions e^"', 
which are referred to as its basis functions. The Laplace transform uses e sl as 
the basis functions, where the independent Laplace variable 5 is complex and is 
given by 5 = a + ja>. The Laplace transform is, therefore, a generalization of the 
CTFT, since the independent variable .5 can take any value in the complex s-plane 
and is not simply restricted to the imaginary jw-axis, as is the case for the CTFT. 
In this chapter, we will cover the Laplace transform and its applications in the 
analysis of LTIC systems. To illustrate the usefulness of the Laplace transforms 
in signal processing, some real-world applications are presented in Chapter 8. 

Chapter 6 is organized as follows. Section 6. 1 defines the bilateral, or two- 
sided, Laplace transform and provides several examples to illustrate the steps 
involved in its computation. The bilateral Laplace transform is used for non- 
causal and causal signals. For causal signals, the bilateral Laplace transform 
simplifies to the one-sided, or unilateral, Laplace transform, which is covered in 
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Section 6.2. Section 6.3 computes the time-domain representation of a Laplace- 
transformed signal, while Section 6.4 considers the properties of the Laplace 
transform. Sections 6.5 to 6.9 propose several applications of the Laplace trans- 
form, ranging from solving differential equations (Section 6.5), evaluating the 
location of poles and zeros (Section 6.6), determining the causality and stability 
of LTIC systems from their Laplace transfer functions (Sections 6.7 and 6.8), 
and analyzing the outputs of LTIC systems (Section 6.9). Section 6.10 presents 
the cascaded, parallel, and feedback configurations for interconnecting LTI 
systems, and Section 6.11 concludes the chapter. 

6.1 Analytical development 

CTFT 

In Section 5.1, the CTFT pair, x(t)< > A" (jo/), was defined as follows: 

OO 

CTFT synthesis equation x(t) = — [ XQatye^'dco; (6.1) 

2it J 

— OO 
OO 

CTFT analysis equation *(*») = / XOe^d,. (6.2, 

— OO 

In Eqs. (6.1) and (6.2), the CTFT of x(t) is expressed as X(ja>), instead of 
the earlier notation X(a>), to emphasize that the CTFT is computed on the 
imaginary jw-axis in the complex s-plane. For a CT signal x(t), the expression 
for the bilateral Laplace transform is derived by considering the CTFT of the 
modified version, x(t)e~ at , of the signal. Based on Eq. (6.2), the CTFT of the 
modified signal x(t)e~ al is given by 

OO 

%{x{t)e - a ' } = J x{t)e~ a ' Q~ iwt dt , (6.3) 

— OO 

which reduces to 

OO 

3W „e-| _ / a„)e- + «'d, 

— OO 

= X(a+ jco). (6.4) 

Substituting s = a + j&> in Eq. (6.4) leads to the following definition for the 
bilateral Laplace transform: 

OO 

Laplace analysis equation X(s) = 3{x(r)e” CTf } = J x(t)e~ s, dt. (6.5) 

— OO 

t The Laplace transform was discovered originally by Leonhard Euler (1707—1783), a prolific 
Swiss mathematician and physicist. However, it is named in honor of another mathematician 
and astronomer, Pierre-Simon Laplace (1749-1827), who used the transform in his work on 
probability theory. 
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To derive the synthesis equation for the bilateral Laplace transform, consider 

CTFT 

the inverse transform of the CTFT pair, x(t)e~ ar < >X(a + jot) = X (.v). 

Based on Eq. (6.1), we obtain 

OO 

x(t)e~ al = — f X(s)e j[U 'd&). (6.6) 

2it J 

— OO 

Multiplying both sides of Eq. (6.6) by e CT ' and changing the integral variable co 
to s using the relationship s = <r + jco yields 

(T-JOO 

Laplace synthesis equation x(t) = / X{s)s !, ds. (6.7) 

2tt j J 

<T-j00 

Solving Eq. (6.7) involves the use of contour integration and is seldom used 
in the computation of the inverse Laplace transform. In Section 6.3, we will 
consider an alternative approach based on the partial fraction expansion to 
evaluate the inverse Laplace transform. Collectively, Eqs. (6.5) and (6.7) form 
the bilateral Laplace transform pair, which is denoted by 

x(t) X(s). (6.8) 

To illustrate the steps involved in computing the Laplace transform, we consider 
the following examples. 

Example 6.1 

Calculate the bilateral Laplace transform of the decaying exponential function: 
x(t) = e~ a, u(t). 


Solution 

Substituting x(t ) = e~ al u(t) in Eq. (6.5), we obtain 


X(s) = 


J e~ a ' u(t)e~ st dt 


— OO 


OO 

J e~ (s+a)r dt 

o 


(s + a) 


OO 

0 


At the lower limit, t — * 0, e _(s+a)f = 1 . At the upper limit, t -> oc, e~ (s+ " K = 0 
if Re{j + a} > 0 or Re{^} > —a. If Re{s} < —a, then the value of is 

infinite at the upper limit, t —> oo. Therefore, 


*(s) = 


1 

forRefi} > —a 

(s + a) 

undefined forRe{5}<— a. 


The set of values of s over which the bilateral Laplace transform is defined 
is referred to as the region of convergence (ROC). Assuming a to be a real 
number, the ROC is given by Re { s } > — a for the Laplace transform of the 
decaying exponential function, x{t) = s~ a, u(t). Figure 6.1 highlights the ROC 
by shading the appropriate area in the complex s-plane. 
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Fig. 6.1. (a) Exponential 
decaying function 
x(t) = e~ a, u(t); (b) its 
associated ROC, Re{s) > -a, 
over which the bilateral Laplace 
transform exists. 


Example 6. 1 shows that the bilateral Laplace transform of the decaying expo- 
nential function.r(f) = will converge to a finite value X(s) = l/(s + a) 

within the ROC (Re{.v) > —a). In other words, the bilateral Laplace transform 
of x(t) = e~ at u(t) exists for all values of a within the specified ROC. No restric- 
tion is imposed on the value of a for the existence of the Laplace transform. 
On the other hand, the CTFT of the decaying exponential function exists only 
fora > 0. Fora < 0, the exponential function xit) = e a, u(t) is not absolutely 
integrable, and hence its CTFT does not exist. This is an important distinction 
between the CTFT and the bilateral Laplace transform. The CTFT exists for a 
limited number of absolutely integrable functions. By associating an ROC with 
the bilateral Laplace transform, we can evaluate the Laplace transform for a 
much larger set of functions. 


Example 6.2 

Calculate the bilateral Laplace transform of the non-causal exponential function 
g(t) = -e~ a <u(-t). 


Solution 

Substituting g(t) = —e~ at u(—t) in Eq. (6.5), we obtain 


G(s) = 


OO 

-f 


' u(-t)e s 'dt = 


U 

-I 


-(s+afr^ _ 


1 


a -(s+a)f 


(s + a ) 


At the upper limit, t — > 0, e _(,s+a) ' = 1. At the lower limit, t — > — oo, 
is finite only if Re{v + a) < 0, where it equals zero. The bilateral Laplace 
transform is therefore given by 


G(s) = 


1 

for Refs} < —a 

(s +a) 

undefined forRe{s}>— a. 


Figure 6.2 illustrates the ROC, Re{s} < —a, for the bilateral Laplace transform 
of g(t) = —e~ at u(—t). 
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(a) 


(b) 


Fig. 6.2. (a) Non-causal 
decaying function 
x (f) = -e~ of u(-f); (b) its 
associated ROC, Re{s) < -a, 
over which the bilateral Laplace 
transform exists. 


In Examples 6. 1 and 6.2, we have proved the following Laplace transform pairs: 
e~ a, u(t) 

and 


Jki, — _ — wit h ROC: Re{s} > - a 

(s + a) 


— e a 'u(—t) with ROC: Refs} < —a. 

(s + a) 


Although the algebraic expressions for the bilateral Laplace transforms are the 
same for the two functions, the ROCs are different. This implies that a bilateral 
Laplace transform is completely specified only if the algebraic expression and 
the ROC are both specified. This is illustrated further in Example 6.3. 


Example 6.3 

Calculate the inverse Laplace transform of the function H(s) = I /{s + a) . 


Solution 

Lrom Examples 6. 1 and 6.2, we know that 

e~ a, u(t) -fi-* with ROC: Re{s} > —a 

is + a) 


and 


'«(-*) 


1 


is + a) 


with ROC: Refs} < —a. 


Therefore, the inverse bilateral Laplace transform is either h(t) = e~ al u(t) or 
li(t) = —e~ a 'u(—t). If we want to determine a unique inverse, we need to 
specify the ROC associated with the Laplace transform. If the ROC is specified 
as Re{s} > —a, then the inverse Laplace transform hit) — e~ at u(t). On the 
other hand, if the ROC is Re{.v| > —a, then h(t) = e -a, M(f). 

The need to specify the ROC is also evident from the synthesis equation, 
Eq. (6.7), of the Laplace transform. To evaluate the inverse Laplace transform 
using Eq. (6.7), a straight line, parallel to the jto-axis, corresponding to all points 
s satisfying Re{y } = a within the ROC, is used as the contour of integration. The 
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complex integral, therefore, cannot be computed without having prior knowl- 
edge of the ROC. 


In Section 6.1, we introduced the bilateral Laplace transform that is used to 
analyze both causal and non-causal LTIC systems. In signal processing, most 
physical systems and signals are causal. Applying the causality condition, the 
bilateral Laplace transform reduces to a simpler version of the Laplace trans- 
form. The Laplace transform for causal signals and systems is referred to as the 
unilateral Laplace transform and is defined as follows: 


where the initial conditions of the system are incorporated by the lower limit 
(t — 0”). In our subsequent discussions, we will mostly use the unilateral 
Laplace transform. For simplicity, we will omit the term “unilateral,” there- 
fore the Laplace transform implies the unilateral Laplace transform. When we 
refer to the bilateral Laplace transform, the term “bilateral” will be explicitly 
stated. To clarify further the differences between the unilateral and bilateral 
Laplace transform, we summarize the major points. 

( 1 ) The unilateral Laplace transform simplifies the analysis of causal LTIC sys- 
tems. However, it cannot analyze non-causal systems directly. Since most 
physical systems are naturally causal, we will use the unilateral Laplace 
transform in our computations. The bilateral transform will be used only 
to analyze non-causal systems. 

(2) For causal signals and systems, the unilateral and bilateral Laplace trans- 
forms are the same. 

(3) The synthesis equation used for calculating the inverse of the unilateral 
Laplace transform is the same as Eq. (6.7) used for evaluating the inverse 
of the bilateral transform. 

Example 6.4 

Calculate the unilateral Laplace transform for the following functions: 

(i) unit impulse function, Xi (t) = S(t ); 

(ii) unit step function, X 2 (t) = u(t): 

(iii) shifted gate function. 


6.2 Unilateral Laplace transform 


oo 



(6.9) 


o 


* 3(0 = 


1 2<t <4 

0 otherwise; 


(iv) causal complex exponential function, Xu (?) = e SCOQ 'u(ty, 
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(v) 

(vi) 

(vii) 


causal sine function, Xs(t) = sin(a>ot)u(t); 
causal ramp function, X(, (t) = tu(t); 

2t 0 < t < 1 
Xj(t) = 2 1 < t < 2 

0 otherwise. 


Solution 

(i) Unit impulse function. Substituting X\(t) = S(t ) in Eq. (6.9) yields 

CO 

*i(s) = J S(t)e~ s, dt. 


Since S(t)e st = <5(0, the above equation reduces to 


OO 

-/■ 


Xi(s) = / <5(?)df = 1. 
o- 

The Laplace transform for an impulse function is given by 
<5(0 < > 1 with ROC: entire s-plane. 

(ii) Unit step function. Substituting X 2 U) = u(t ) in Eq. (6.9) yields 


OO 

^ 2 ( 5 ) = J u(t)e~ s 'dt. 

0 - 

For Re { .v } > 0, the above integral reduces to 


CO 

/' 


^ 2 ( 5 ) = / e ”dr = — e 


= 1. 


The Laplace transform for a unit step function is given by 

u(t) ^ - with ROC: Ref^j > 0. 
s 

(iii) Shifted gate function. Substituting * 3(0 in Eq. (6.9) yields 

4 


X 3 (.s) = / e -sr df = -je _ 




4 


= -(e _2s - e- 45 ). 


Clearly, the above expression for the Laplace transform is not valid for s — 0. 
The value of the Laplace transform for s = 0 is obtained by substituting s = 0 
in Eq. (6.9). The resulting expression is given by 


*3(0 = 


= J x-}(t)dt = J 1 • dr = 1 1 4 = 2, for s — 0. 
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The Laplace transform for the shifted gate function is therefore given by 

2 for s — 0 


X 3 (s) = 


-(e 2s — e 4i ) for s ^ 0. 


The associated ROC is the entire s-plane. 

(iv) Causal complex exponential function. From Example 6. 1, we know that 

1 




(s + a) 

Substituting a = j&>o, we obtain 

l 1 


-J®0 


«(0 


with ROC: Re{s} > — Re{a}. 


with ROC: Re{s) > 0. 


(s + jtt> 0 ) 

(v) Causal sine function. By expanding sin(&>oO = [exp(ja>oO — 
exp(— jcuo ? )]/2j. the Laplace transform for the causal sine function is 
given by 


X 5 0) = — [ [e j “ 0 ' - e-j^le^'d t =— [ e -(s-j£0o)f d t - — [ < 

2j J 2j J 2j J 




Both integrals are finite for Re {.s' ±ja>ol > 0 or Re{,s| > 0. The Laplace trans- 
form is given by 


1 

' 1 ' 

1 

' 1 ' 

tt>0 

2j 

.s - ja>o_ 

2j 

m s + j<w 0 . 

s 2 + u>l 


In other words, the Laplace transform pair is given by 

L COq 


sin(a>o t)u(t) 


with ROC: Re{s} > 0. 


S 1 + COq 

(vi) Causal ramp function. Substituting X(,{t ) = tu(t) in Eq. (6.9) yields 


CXJ OL 

X 6 (s ) = J r«(r)e - "dr = J re - " dr = 


re 


(-«) 


(~s ) 2 


which, on simplification, leads to the following Laplace transform pair: 


tu{t) \ with ROC: Re{s} > 0 . 


(vii) Substituting 


xiit) = 


[It 0 < t < 1 

2 l < r < 2 

0 otherwise 


in Eq. (6.9) leads to the following Laplace transform: 



f re - " e - " 1 

1 

r e - " 1 

X 7 (s) = 2 / re "dr + 2 / e "dr = 2 


+ 2 


J J 

L -s (-^) 2 J 

0- 

_ _ 


o- 1 
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Clearly, the above integral is not defined for s — 0. For s ^ 0, the above expres- 
sion reduces to 


Xj(s) = 2 


e s e s 1 

4- ? 

~e~ 2s 

e~ s ~ 

_ — 5 (— s) 2 ' (—s) 2 _ 

r ^ 

—s 

—s _ 


= -~[l-e- 


■se~ 2j ]. 


For s — 0, the Laplace transform is given by 

oo 1 2 

X 7 (s)= r 


= J x 7 {t)dt = J 2t ■ At + J ■ 


= I 2t ■ At + I 2- At = t 2 \ l Q + 2t\\ = 3. 


o- 


The Laplace transform pair is therefore given by 


X 7 (s) 



for s = 0 
for s / 0. 


The associated ROC is the entire s-plane. 


6.2.1 Relationship between Fourier and Laplace transforms 

Comparing Eq. (6.2) with Eq. (6.5), the CTFT can be related to the bilateral 
Laplace transform as follows: 

OO 

X(jw)= J x(t)e-> a, At = X(s)U jtt) . (6.10) 

— OO 

Since, for causal functions, the bilateral and unilateral Laplace transforms are 
the same, the above relationship is also valid for the unilateral Laplace transform 
for causal functions. Equation (6.8) proves that the CTFT is a special case of 
the Laplace transform when s = j u>, i.e. o = 0. In other words, the CTFT is 
the Laplace transform computed along the imaginary ja>-axis in the s-plane. 
Table 6. 1 lists the Laplace transforms for several commonly used functions. To 
compare the results with the corresponding CTFTs, we also include the CTFTs 
for the same functions in the second column of Table 6. 1 . When the function 
is causal and its CTFT exists, it is observed that the CTFT can be obtained 
from the Laplace transform by substituting s = ja>. An alternative condition for 
the existence of the CTFT is, therefore, the inclusion of the jw-axis within the 
ROC of the Laplace transform. If the ROC does not contain the jo>-axis, the 
substitution s = ja> cannot be made and the CTFT does not exist. For example, 
the ROC Reji'} > 0 for the unit step function x(t) — u(t) does not contain the 
j&>-axis. Based on our earlier reasoning, its CTFT should not exist. This appears 
to be in violation with the second entry in Table 6.1, where the CTFT of the 
unit step function is listed as follows: 

CTFT 

U(t) < > 7T <$(&)) + 1 /j (O. 


Table 6.1. CTFT and Laplace transform pairs for several causal CT signals 


CT signals x(t) 


CTFT 


X(jco) = J x(t)^°”dt 


Laplace transform 




X(s)= / x(t)e~ s, dt 


(1) Impulse function 
x(t) = S(t) 

(2) Unit step function 
x(t) = u(t ) 


(3) Causal gate function 
x(t) = u(t) — u(t — a) 


(4) Causal decaying exponential function 
x(t) = er a, u(t) 

(5) Causal ramp function 
x(t) = tu(t) 


(6) Higher-order causal ramp function 
x(t) = t n u(t) 


(7) First-order time-rising causal decaying 
exponential function 

x(t) = te~ a, u(t) 

(8) Higher-order time-rising causal 
decaying exponential function 
x{t) = t n e~ a, u(t) 

(9) Causal cosine wave 
x(t) = cos(a>oO u (0 


(10) Causal sine wave 
x(t) = sin(a)ot)w(?) 


(11) Squared causal cosine wave 
x{t) = cos 2 (a>or)«(r) 


(12) Squared causal sine wave 
jt(f) = sin 2 (a>ot)n(f) 


(13) Causal decaying exponential cosine 
function 

A'(f) = exp(— a?) cos(a>oO«(0 

(14) Causal decaying exponential sine 
function 

a(?) = exp (—at) sm(a>ot)u(t) 


1 


1 

7vS(cd) H 

jtu 


(1 - e-i™) (nS(co) + 


1 

a + ja> 


does not exist 


does not exist 


1 

(a + jo)) 2 
provided a > 0. 

n\ 

( a + ja>)" +1 
provided a > 0 

7t[5(o> — a>o) + 5(a) + a>o)f 

+ ^ 

015 — co 2 

^[5(aj-tuo)-a(w + <uo)] 

2j 

(DO 

■ 2 9 

CDq “ 

— [5(&>) -|- <5(&> — 2&>o) “I - + 2ct>o)] 

1 j co 

)2a> 2 (4&)q — cu 2 ) 

— [<5(a)) — S (w — 2a>o) — 5(a) + 2a) 0 )] 



y 2ai 2 (4a)g — a; 2 ) 
a + ja) 

(a + ja)) 2 + a>l 
provided a > 0 
a)p 

(a + ja;) 2 + u> 2 0 
provided a > 0 


1 

ROC: entire s-plane 
1 

■s 

ROC: Re{s) > 0 

-0 - e—) 
s 

ROC: Re{s} > 0 
1 

a + s 

ROC: Re{.f) > -a 
1 

s 2 

ROC: Refs) > 0 
n\ 

s n+l 

ROC: Refs) > 0 
1 

(a + .s) 2 

ROC: Re{y) > -a 
n\ 

(a + s)" +1 
ROC: Re{.v) > -a 
s 

a>g + s 2 

ROC: Re{.v) > 0 

O)o 

a> o + s 2 

ROC: Re{4 > 0 

(2q)q + ,y 2 ) 

s(4a>l + s 2 ) 

ROC: Re{.v) > 0 

M 

s(4a% + s 2 ) 

ROC: Re{.v) > 0 

a + s 

(< a + s ) 2 + a>Q 
ROC: Re{.v) > -a 

U)Q 

(a + s) 2 + o)q 
ROC: Re{s} > -a 
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The above argument is not true because the CTFT of the unit step function 
contains a discontinuity at co — 0 due to the presence of the impulse function 
S(co). Therefore, the CTFT violates the condition for the existence of CTFT. In 
such cases, the CTFT is not derived from its definition but is expressed using 
the impulse function, which is not a mathematical function in the strict sense. 
It is therefore natural to expect Eq. (6.10) to be invalid. Likewise, the ROC for 
the Laplace transform of the sine wave, cosine wave, squared cosine wave, and 
squared sine wave do not contain the jw-axis, and Eq. (6.10) is also not valid 
in these cases. 


6.2.2 Region of convergence 


As a side note to our discussion, we observe that the Laplace transform is 
guaranteed to exist at all points within the ROC. For example, consider the 
causal sine wave h(t) — sin(4 t)u(t). We are interested in calculating the values 
of the Laplace transform at two points, .y| = 2 + j3 and 52 = j3 in the complex 
s-plane. Since ,V| lies within the ROC, Re{.y} > 0, the value of the Laplace 
transform at .sq is given by 


H( 2 + j3) 


4 

(2 + j3) 2 + 4 2 


4 

4 + j!2 — 9 + 16 


4 

H+jl2’ 


which, as expected, is a finite value. The point ,s '2 = j3 lies outside the ROC. 
However, the Laplace transform is not necessarily infinite at S 2 - In fact, the 
Laplace transform of the causal sine wave h(t) = s\n(4t)u(t) is finite for all 
values of s on the imaginary axis except at s = ±j4. The value of the Laplace 
transform at S 2 is given by 


H( j3) = 


4 

(j3) 2 + 4 2 


4 

5' 


Since the Laplace transform is not defined at two points (5 = ±j4) on the 
imaginary axis, the entire imaginary axis is excluded from the ROC. In short, if 
a point lies on the boundary of the ROC, it is possible that the Laplace transform 
exists, though the point may not be included in the ROC. 


6.2.3 Spectra for the Laplace transform 

In Chapter 5, the magnitude and phase spectra of the CTFT provided mean- 
ingful insights into the frequency properties of the reference function. Except 
for one difference, the magnitude and phase spectra of the Laplace transform 
(collectively referred to as the Laplace spectra) can be plotted in a similar way. 
Since the Laplace variable ,v is a complex variable, the Laplace spectra are 
plotted with respect to a 2D complex plane with Re{^} = a and Im{s} = co 
being the two independent axes. For the magnitude spectrum, the magnitude 
of the Laplace transform is plotted along the z-axis within the ROC defined 
in the 2D complex plane. Likewise, for the phase spectrum, the phase of the 
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1 
















Imfs} = CO 


Re{s} = cr 


Im{s} = co Re{s} = <7 


(a) 


(b) 


Fig. 6.3. Laplace spectra for 
x(t) = e^‘u{t). (a) Laplace 
magnitude spectrum; 

(b) Laplace phase spectrum. 


Laplace transform is plotted along the vertical z-axis within the ROC. Both 
Laplace magnitude and phase spectra are, therefore, 3D plots. To illustrate the 
steps involved in plotting the magnitude and phase spectra, we consider the 
following example. 


Example 6.5 

Plot the Laplace spectra of the decaying exponential function x(t) = e~ ir u(t). 


Solution 

Based on entry (4) of Table 6. 1 , the Laplace transform of the decaying expo- 
nential function is given by 


X(s) = 


1 

(5 + 3) 


1 

with ROC: a — Re(s) > —3. 

(a+jrn + 3) 


The Laplace spectra are therefore given by 

1 

magnitude spectrum |X(j)| = ; 

x/ (cr + 3) 2 + a> 2 

-i m 

phase spectrum <X(,5') = —tan . 

(<r + 3) 


The magnitude and phase spectra are plotted with respect to the 2D complex 
s-plane in Fig. 6.3. To obtain the CTFT spectra, we can simply splice out the 
2D plot along the Re{j} — a — 0 axis from the Laplace spectra. Figure 6.4 
shows the resulting CTFT magnitude and phase spectra. These are identical to 
the CTFT spectra obtained directly from the CTFT and plotted in Fig. 6.4. 


Fig. 6.4. CTFT spectra for 
x(t) = e^uit) obtained by 
extracting the 2D plot along the 
Re{s) = cr = 0 axis in Fig. 6.3. 

(a) CTFT magnitude spectrum; 

(b) CTFT phase spectrum. 



0 


<X(ai) 
■— nil 


► 0 ) 



► ro 


(a) 


(b) 
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6.3 Inverse Laplace transform 


Evaluation of the inverse Laplace transform is an important step in the analysis 
of LTIC systems. The inverse Laplace transform can be calculated directly by 
solving the complex integral in the synthesis equation, Eq. (6.7). This approach 
involves contour integration, which is beyond the scope of this text. In cases 
where the Laplace transform takes the following rational form: 


N (s) b m s m + b m -\s m 1 + b m - 2 S m " + ••■ + b\s + bo 


X(s) = 


m—2 


D(s) 


s" + a n -\s"~ l + a n _ 2 s n ~ 2 H h + flo 


( 6 . 11 ) 


an alternative approach based on the partial fraction expansion is commonly 
used. The approach eliminates the need for computing Eq. (6.7) and consists 
of the following steps. 

( 1 ) Calculate the roots of the characteristic equation of the rational fraction, Eq. 
(6. 11). The characteristic equation is obtained by equating the denominator 
D(s) in Eq. (6. 1 1 ) to zero, i.e. 

D(s) = s n + ci n —\S n ^ T G n — 2 s n d - • • • T o.\ s T Gq = 0. (6.12) 

For an nth-order characteristic equation, there will be n first-order roots. 
Depending on the value of the coefficients { b /}, 0 </<(«— 1), roots 
{A }> 1 5 r < n, of the characteristic equation may be real- valued and/or 
complex-valued. Assuming that roots are real-valued and do not repeat, the 
Laplace transform X (.s ) is represented as 


X(s) = 


N(s ) 


(S - Pl)(s - Pi) ■ ■ ■ (s - p,,-l)(s - p n ) 


(6.13) 


(2) Using Heaviside’s partial fraction expansion formula, explained in 
Appendix D, decompose X(s ) into a summation of the first- or second- 
order fractions. If no roots are repeated, X(s) is decomposed as follows: 


X(s) = 


k 2 


k n - 


k n 


(s - p l) (s - p 2 ) (s - Pn- 1 ) (s - P„) 

where the coefficients {£,-}, 1 < r < n, are obtained from 

N{sY 


k r = 


0 - Pr) 


D(s) 


(6.14) 


(6.15) 


s=p r 


If there are repeated or complex roots, 21(5) takes a slightly different form. 
See Appendix D for more details. 

(3) From Table 6.1, 


1 


with ROC: Re{,s} > p r . 


e Pr ‘u(t ) 


(s - Pr) 
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Using the above transform pair, the inverse Laplace transform of X (s ) is 
given by 

x(t) = k\t Pl ‘u(t) + k 2 Z P2 ‘u(t) + ■ ■ ■ + k n -\t Pn ~'' u(t) + k n e Pnt u{t) 

n 

= J2 k r e Prt u(t). (6.16) 

r= 1 

To illustrate the aforementioned procedure (steps (1) to (3)) for evaluating the 
inverse Laplace transform using the partial fraction expansion, we consider the 
following examples. 


Example 6.6 

Calculate the inverse Laplace transform of a right-sided sequence with transfer 
function 


G(s) = 


Is -6 
(s 2 — s — 6) 


Solution 

The characteristic equation of G(s) is given by s 2 — s — 6 = 0, which has 
two roots at s = 3 and —2. Using the partial fraction expansion, the Laplace 
transform G(s) is expressed as 


G(s) = 


Is -6 

(s + 2)(s - 3) 


h k 2 

{s + 2) + {s -3) 


The coefficients of the partial fractions k\ and k 2 are given by 


ki 


(s + 2) 


(75 - 6) 
(5 + 2)(s - 




r (75 - 6)i 

3)J 

1 

CM 

1 

II 

L (5 - 3) J 


= 4 


and 


kj = 


(5 - 3)- 


(75 - 6) 



r (75 - 6)i 

- s=3 

L (5 + 2) J 


= 3. 


(5 + 2)(5 -3). 

The partial fraction expansion of the Laplace transform G(s) is therefore given 
by 

4 3 

G(s) = 


(5 + 2) (5 - 3) 

Using entry (4) of Table 6.1, the inverse Laplace transform is 


g (t) = (4e 2r + 3 e 3 ')«(r). 


Example 6.7 

Calculate the inverse Laplace transform of right-sided sequences with the fol- 
lowing transfer functions: 


(i) Xds) = 


s T 3 

5(5 + 1)(5 + 2) 


5 T 5 

s 2, T 5s 2 -f- 175+ 13' 


(ii) X 2 (s) = 
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Solution 

(i) In X i fi'), the characteristic equation is already factorized. In terms of the 
partial fractions, X \ (s) can be expressed as follows: 


*i(s) 


s + 3 _ ki k 2 

s(s + 1)(5 + 2) s (s + 1) 


+ 


kj 

(s + 2) 


where the partial fraction coefficients k \ , k 2 , and k 2 are given by 


(5 + 3) 


r (5 + 3) 1 

s(s + l)(.s + 2)_ 

s=0 

,(s+ l)(5 + 2)_ 


and 


k 2 = 


ks = 


(s+1) 


(s + 3) 


(5 + 2) 


s(s + l)(s + 2) 
(5 + 3) 



r (5 + 3) I 

J s=—l 

_s(s + 2)_ 



r (5 + 3) ] 

- s——2 

_ s(s + 1). 


= - 2 , 


S=— 1 


s =— 2 


s(s + l)(s + 2) _ 

The partial fraction expansion of the Laplace transform ^(s) is given by 

*i(s) = 


s + 3 


1 


s(s + l)(s + 2) 2s (s + 1) 2(s + 2) 

which leads to the following inverse Laplace transform: 


x\{t) = ( - - 2e ’ + - 


,—2t 


u(t). 


,2 2 
(ii) The characteristic equation of Xiis) is given by 
D(s) = s 3 + 5s 2 + 17s + 13 = 0, 

which has three roots at s = —1, —2, and ±j3. The partial fraction expansion 
of X 2 (s) is given by 

s + 5 


* 2 ( 5 ) = 


k\ k 2 s + k 2 


(s + l)(5 + 2 + j3)(s + 2^j3) (s+1) (s 2 + 4s + 13) 

The partial fraction coefficient ki is calculated to be 

ki = 


(s + D 


(5 + 5) 


(s + l)(s 2 + 4s+ 13) 


S =— 1 


D + 5) 


(s 2 + 4s + 13) J _! 


To compute coefficients k 2 and k 2 , we substitute k\ = 2/5 in + 2 ( 5 ) and expand 
s + 5 _ 2 | k 2 s + k 2 

(s+ l)(s 2 + 4s+ 13) 5(s + 1) + (s 2 + 4s + 13) 


s + 5 = 0.4(s 2 + 4s + 13) + (k 2 s + D)(s + 1). 

Comparing the coefficients of s 2 on both sides of the above expression yields 
k 2 + 0.4 = 0 => k 2 — —0.4. 
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Similarly, comparing the coefficients of s yields 

k 2 + &3 + 1.6 = 1 =>■ A'3 = —0.2. 


The partial fraction expansion of ASfv) reduces to 


X 2 (s) = 


2 2s + 1 

0.2 , 

5(s+l) (5 + 2) 2 + 9 


which is expressed as 


X 2 (s) = 


2 

5 (s + 1) 


- 0.2 


2 (s + 2) 

(5 + 2) 2 + 9 


+ 0.2 


3 

{s + 2)2 + 9’ 


Based on entries (4) and (13) in Table 6.1, the inverse Laplace transform is 
given by 


X\(t ) = (0.4e ‘ — 0.4e 2r cos(3 1) + 0.2e 2t sin(3 t))u(t). 


6.4 Properties of the Laplace transform 


The unilateral and bilateral Laplace transforms have several interesting prop- 
erties, which are used in the analysis of signals and systems. These properties 
are similar to the properties of the CTFT covered in Section 5.4. In this section, 
we discuss several of these properties, including their proofs and applications, 
through a series of examples. A complete listing of the properties is provided 
in Table 6.2. In most cases, we prove the properties for the unilateral Laplace 
transform. The proof for the bilateral Laplace transform follows along similar 
lines and is not included to avoid repetition. 


6.4.1 Linearity 

If Xi(t) and X 2 (t) are two arbitrary functions with the following Laplace trans- 
form pairs: 


x\ (t) 


Xy{s) 


with ROC: R i 


and 

x 2 (t) X 2 (s) with ROC: R 2 > 

then 

ayX\{t) + a 2 x 2 (t) + a 2 X 2 (s) with ROC: at least Ri n R 2 

(6.17) 


for both unilateral and bilateral Laplace transforms. 
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. g(0 

Pr~i .. 

-4 -3 -2 -1 0 1 2 3 4 

Fig. 6.5. Causal function g(t) 
considered in Example 6.8. 


Proof 

Calculating the Laplace transform of{ai*i(0 + a\x 2 (t)} using Eq. (6.9) yields 

OO 


L{aiXi(t) + a 2 x 2 (t)} 


J {a\X\{t) + a 2 x 2 (t)}e s 'd t 
o- 


OO 

J a\X\(t)oT st dt 
o- 


oo 


OO 

+ J a 2 x 2 (t)e~ u dt 
o- 

OO 


= ai J Xi(t)e sr dt + a 2 J x 2 (f)e s 'd t 
o- o- 

= <2i*i(0 + a 2 X 2 (s), 


f 


which proves Eq. (6.17). 

By definition of the ROC, the Laplace transform Xi(s) is finite within the 
specified region Ri. Similarly, X 2 (s) is finite within its ROC AS. Therefore, the 
linear combination aiXi(s) + a 2 X 2 (s) must at least be finite in region R that 
represents the intersection of the two regions i.e. R — Ri IT R 2 . If there is no 
common region between R\ and AS, then the Laplace transform of {a\X\(t) + 
a\X 2 (t)} does not exist. Due to the cancellation of certain terms in a\ X i(.s ) + 
a 2 X 2 (s), it is also possible that the overall ROC of the linear combination is 
larger than R\ fl R 2 . To illustrate the application of the linearity property, we 
consider the following example. 

Example 6.8 

Calculate the Laplace transform of the causal function g(t) shown in Fig. 6.5. 


Solution 

The causal function g(t) is expressed as the linear combination 


g(t) = 4x 3 (0 + 2*7(0, 


where the CT functions x 2 (t) and x 2 (t) are defined in Example 6.4. Based on 
the results of Example 6.4, the Laplace transforms for x 2 (t ) and x 2 (t) are given 
by 


*3(0 


2 for 5 = 0 

1 - , with ROC: entire s-plane 

-[e -2 — e -4 ] fors^O 

5 


and 

3 for 5 = 0 

*41 — e” 1 — .se -2s ] for^^O. 
s l 


*7(0 = 


with ROC: entire s-plane 
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6.4.2 Time scaling 



-4 -3 -2 -1 0 1 2 3 4 

Fig. 6 . 6 . Causal function /7(f) 
considered in Example 6.9. 


Applying the linearity property, the Laplace transform of g(t) is given by 
' 4(2) + 2(3) for j = 0 


G(s) = 

which reduces to 


-(e- 2 * 

s 


G(s) = 


e” 4s )+-[l 

s z 


14 

4 


■ se 


for t / 0, 


for 5 = 0 


-r-[l — e s — se 4i ] for s ^ 0. 


Note that the ROC of G(s) is the intersection of the individual regions R\ and 
AN. The overall ROC R is, therefore, the entire s-plane. 


If x(t) < — > X (s ) with ROC: 7?, then the Laplace transform of the scaled signal 
x(at), where a e )H + , a > 0, is given by 

x{at) — x(-) with ROC: a R (6.18) 

\a\ Vo/ 

for both unilateral and bilateral Laplace transforms. For the unilateral Laplace 
transform, the value of a must be greater than zero. If a < 0, the scaled signal 
x(at) will be non-causal such that its unilateral Laplace transform will not exist. 


Proof 

By Eq. (6.9), the Laplace transform of the time-scaled signal x(at) is given by 


L{x(at)} = I x(at)e ‘ s 'df 


-f 

0 - 

oo 

= J x(r)Q ~ sz / a — (by substituting r = at) 


dr 


o- 


= -X - 


(;)• 


which proves Eq. (6.18) for a > 0. To prove that the ROC of the Laplace 
transform of the time-scaled signal is aR, note that the values of X(s) are finite 
within region R. For X(s/a), the new region over which X(s/a) is finite will 
transform to aR. 


Example 6.9 

Calculate the Laplace transform of the function h{t) shown in Fig. 6.6. 

Solution 

In terms of the causal function Xj(t), signal h(t) is expressed as 
h(t) — 1.5x7 ( - j or h(t) = 1.5x 7 (0.5r). 
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In Example 6.4, the Laplace transform of Xq(t) is given by 

for s = 0 


*7(s) = 


3 

4[l-e--«r*] fors^O, 


with the entire s-plane as the ROC. 

Using the time-scaling property the Laplace transform of h(t) is given by 


h(t) = 1.5x7(0.50 ^(1.5)X 7 (^) = 3X V (2 s) with 


ROC: 2R\, 


which reduces to 


for s = 0 


H(s)= \ 1.5 


[1 - e _2s - 2se~ 4 '] for j ^ 0. 


The ROC associated with II (s) is the entire s-plane. 


6.4.3 Time shifting 

If x{t) < > X (.v ) with ROCi/Cthen the Laplace transform of the time-shifted 

signal is 


x(t - t 0 ) e- st °X(s) with ROC: R (6.19) 

for both unilateral and bilateral Laplace transforms. For the unilateral Laplace 
transform, the value of to should be carefully selected such that the time-shifted 
signal x(t - to) remains causal. There is no such restriction for the bilateral 
Laplace transform. Also, it may be noted that time shifting a signal does not 
change the ROC of its Laplace transform. 


Proof 

By Eq. (6.9), the Laplace transform of the time-shifted signal x(t - to) is given 
by 


OC 

-f 


L{x(t - f 0 )} = / x(t - f 0 )e ' d t 


— ~st 0 


oo 

/ 


x(r)e ST dr 


= e--”°X(.s), 


(by substituting r = t — to) 


which proves the time-shifting property, Eq. (6.19). The Laplace transform of 
the time-shifted signal x(t - to) is a product of two terms: exp(— sto) and X (s). 
For linite values of v and to, the first term is always finite. Therefore, the ROC 
of the Laplace transform of the time-shifted signal is the same as X(s). 
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-1 01234567 


Example 6.10 

Calculate the Laplace transform of the causal function f(t) shown in Fig. 6.7. 


Fig. 6.7. Waveform /(f) used in Solution 

Example 6.10. In terms of the waveform h(t) shown in Fig. 6.6, fit) is expressed as follows: 


m = 2/? (t - 3). 


In Example 6.9, the Laplace transform of h(t) is given by 

for s — 0 


H(s) = 


9 

^ [1 - e _2s - 2.se~ 4 *] for s ^ 0, 


with the entire s-plane as the ROC. Using the time-shifting property, the Laplace 
transform of /(f) is 

f{t) = 2 h{t - 3) 2e~ is H{s) with ROC: R, 
which results in the following Laplace transform for fit): 


His) = 


[18e- 3i ] i=0 = 18 for 5 = 0 

4te" 3s 


^—5s 


— 2s e 7i ] for s ^ 0, 


with the entire s-plane as the ROC. 


6.4.4 Shifting in the s-domain 

If xit) < — > X (s ) with ROC: R, then the Laplace transform of 

e 10 ' xit) ^ X(s - s 0 ) with ROC: R + Re{.v 0 } (6.20) 

for both unilateral and bilateral Laplace transforms. Shifting a signal in the 
complex s-domain by so causes the ROC to shift by Re{,s'o}. Although the 
amount of shift so can be complex, the shift in the ROC is always a real number. 
In other words, the ROC is always shifted along the horizontal axis, irrespective 
of the value of the imaginary component in .vq . 

The shifting property can be proved directly from Eq. (6.9) by considering 
the CTFT of the signal expUofWO- The proof is left as an exercise for the 
reader (see Problem 6.6). 

Example 6.11 

Using the Laplace transform pair 

u(t) - with ROC: Re{s} > 0, 

calculate the Laplace transform of (i) x\ it) = cos(cDot)u(t) and (ii) X 2 (0 = 

sin(tt>oOM(0- 
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Solution 

Using the above Laplace transfonn pair and s- shifting property, the Laplace 
transforms of exp(}coot)u(t) and exp(— ja>ot) u(t) are given by 

e j "°'zz(r) with ROC: Re{s} > 0 

0 - j«o) 


and 



1 

(s + m) 


with ROC: Re{s} > 0. 


(i) To calculate the Laplace transform of x\(t) = cos(o>of) u(t), we add the 
above transform pairs to obtain 

e jw< V0 + e~ ,o>0r u(t) + with ROC: Re{s} > 0, 

(s - j«o) (-s + j®o) 

which reduces to 

L S 

cos(cL>ot)u(t) < — > — y with ROC: Re{s) > 0. 

S 2 + COq 


(ii) To evaluate the Laplace transform of X 2 (r) = sinfnjof )w(f ). we take the 
difference of the above transform pairs to obtain 
L 1 1 

e w «(f) - e~J > with ROC: Re{s} > 0 , 

0 - j®o) (s + ja>o) 


which simplifies to 

sin(&> 0 r)zz(r) •<— > -r — ^ with ROC: Re{s} > 0. 

s 2 + 


6.4.5 Time differentiation 


If x (r) < — > A (.v ) with ROC:R, then the Laplace transform of 

— sX(s) - x(0~) with ROC: R. (6.21) 

dr 

Note that if the function x(r) is causal, x(0~) = 0. 

Proof 

By Eq. (6.9), the Laplace transform of the derivative dx/dt is given by 


dx 


dr 


}-/ 


dx 


— = / — e“ s 'dr. 


dr 


Applying integration by parts on the right-hand side of the equation yields 


^ = x(r)e- 


cx. 

>/ 


(-s) / x(r)e _5, dr. 


X(i) 
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Considering the first term, denoted by A, we note that for the upper limit, 
t — > oo, the value of A is zero due to the decaying exponential term. For the 
lower limit, t — > 0~, A equals x(0 _ ). The above equation therefore reduces to 


L 



x(Q~) + sX(s). 


Corollary 6.1 By repeatedly applying the differentiation property n times, it is 
straightforward to prove that 

— s n X(s) - s^x®-) sx { "- 2 \0~) 

d t" 

-x ( " _1) (0“) with ROC: R, (6.22) 

where x (k> denotes the kth derivative of x{t), i.e. x (k> = d k x!dt k . 


Example 6.12 

Based on the Laplace transform pair 

u{t) with ROC: Re{,s} > 0, 

s 

calculate the Laplace transform for the impulse function x(t) — S(t). 


Solution 

Based on entry (2) of Table 6.1, we know that 

u(t) - with ROC: Re{s} > 0. 
s 

Using the time-differentiation property, the Laplace transform of the first deriva- 
tive of u(t) is given by 

du(t) l 1 , . 

dr s 

Knowing that d;//dr = S(t) and = 0, we obtain 

8(t ) 1 with ROC: Re{s} > 0. 


6.4.6 Time integration 


If x(t) 


X(s) with ROC:R, then 


unilateral Laplace transform lx(r)dr 


f X 


L X(s) 


with ROC: R (T Re{s} > 0; (6.23) 


bilateral Laplace transform 


I 

f 


x(r)dr 


l X(s) 1 


U 

/ 


x(r)dr 


with ROC: R O Re{s} > 0. (6.24) 
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Table 6.2. Properties of the Laplace transform 

The corresponding properties of the CTFT are also listed in the table for comparison 



CTFT 

OO 

Laplace transform 


X(jco) — j x(t)e" j “"df 

X(s) = [ x(t)e~ sl At 

Properties in the time domain 

— OO 

J 

— OO 

Linearity 

a\X\{a)) + a 2 X 2 (o)) 

fli^tO) + a 2 X 2 (s) 

aiXi{t) + a 2 x 2 {t) 

1 / <1)\ 
—x(-) 

ROC: at least Ri 0 R 2 

Time scaling 


x(at ) 

|a| Vfl/ 

\a\ Va/ 
with ROC: aR 

Time shifting 

e- j “°'Z(ft)) 

e~ s, °X(s ) 

x(t - t 0 ) 


with ROC: R 

Frequency /s-domain shifting 

X(u> — a>o) 

X(s - s 0 ) 

A(?)e' i<u ° , or jc(t)e 10 ' 


with ROC: R + Re(so) 

Time differentiation 

ja>X(co) 

sX(s) - jc(O-) 

Ax /At 


with ROC: R 

Time integration 

t 

X(a>) 

X(s) 

1- nX(0)S(cL > ) 


J" 

S 

with ROC: R D Re{s} > 0 

J x(r)dr 

— OO 

Frequency /s-domain 

-jdX/dto 

dX /As 

differentiation 

(-0*(0 



Duality 

2nx(co) 

not applicable 

X(t) 

Time convolution 

X!(co)X 2 (co) 

X!(S)X 2 (5) 

Xl (t)*x 2 (t) 


ROC includes R\ 0 R 2 

Frequency/s-domain convolution 
xi(t)x 2 (t) 

^-X 1 (co)^X 2 (co) 

Z7T 

X l (s)*X 2 (s ) 

Z7T 

OO OO 

J \x(t)\ 2 At=X f \X(a>)\ 2 Aat 

ROC includes 

i?i n r 2 


Parseval’s relationship 

not applicable 


— OO — OO 



OO 

1 [ 


Initial value 

— / X(<w)d« 

lim sX(,r) 

a( 0 + ) if it exists 

2n J 

— OO 

S~* OO 

provided .s = oo is included 
in the ROC of sX(s) 


Final value 

A'(oo) if it exists 


not applicable 


limsX(s) 

■ s — >-0 

provided .v = 0 is included 
in the ROC of sX(s) 
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The proof of the time-integration property is left as an exercise for the reader 
(see Problem 6.7). 

Example 6.13 

Given the Laplace transform pair 

L S 

cos(coot)u(t ) < — > — — with ROC: Re{s} > 0, 

0 2 + ®o) 

derive the unilateral Laplace transform of sin(a>ot)u(t). 


Solution 

By applying the time-integration property to the aforementioned unilateral 
Laplace transform pair yields 


/ 


cos(a>or);r(r)dr < 


1 


5 (s 2 + CO 2 ) 

U 

where the left-hand side of the transform pair is given by 


with ROC: Re{s} > 0, 


/ 


cos(&>o r )M( r )d r = / cos(&>or)dr = 


/■ 


sin(&>or) 


co o 


= — sin(tt) 0 f). 
o "o 


0- 0 

Substituting the value of the integral in the transform pair, we obtain 
l co 0 


sin(co 0 t)u(t) 


(s 2 + col) 


with ROC: Re{s} > 0, 


6.4.7 Time and s-plane convolution 

If A'i(f) and x 2 (f) are two arbitrary functions with the following Laplace trans- 
form pairs: 

xi {t) Xi(s) with ROC: Ri and x 2 (t) X 2 (s) with ROC: R 2 , 

then the convolution property states that 

time convolution X\{t) * x 2 (t) Xi(s)X 2 (s) 

containing at least ROC: R\ fl R 2 \ (6.25) 
l 1 

s-plane convolution x\(t)x 2 {t) < — > [X i(a) * 7f2(s)] 

2jrj 

containing at least ROC: Ri H R 2 . (6.26) 

The convolution property is valid for both unilateral (for causal signals) and 
bilateral (for non-causal signals), Laplace transforms. The overall ROC of the 
convolved signals may be larger than the intersection of regions R i and R 2 
because of possible cancellation of poles in the products. 


Proof 

Consider the Laplace transform of X\{t) * *2(0: 


L{xi(t) * x 2 (t)} 


OO 

= J [x 1 (0*x 2 (?)]e~ ir dr 
0- 


CXJ CXJ 

-ff 

0“ Goo 


Xi(r)x 2 (t — r)dr 


e' sr d t. 
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Interchanging the order of integration, we get 


L{x x {t) *x 2 (t)} = 


OO OO 

I 


x 2 (t — r)e sl dt 


Lo- 


dr. 


By noting that the inner integration / x 2 (t— r) exp(—st)dt = X 2 (, s) exp(— sr), 
the above integral simplihes to 


OC 

/ 


L{xdt) *x 2 (t)} = X 2 (s) / xi(r)e _sr dr = X 2 (s)Xi(s), 


— OO 

which proves Eq. (6.25). The s-plane convolution property may be proved in a 
similar fashion. 


Like the CTFT convolution property discussed in Section 5.5.8, the Laplace 
time-convolution property provides us with an alternative approach to cal- 
culate the output y{t) when a CT signal x(t) is applied at the input of an 
LTIC system with the impulse response h(t). In Chapter 3, we proved that 
the zero-state output response y(r) is obtained by convolving the input signal 
x(t ) with the impulse response hit), i.e. y(t) = h(t) * x(f). Using the time- 
convolution property, the Laplace transfonn Y (s) of the resulting output y{t) is 
given by 

yit) = x(t) * h(t) ^ y(s) = X(s)H(s), 

where X(s) and II (s) are the Laplace transforms of the input signal x(t) and 
the impulse response h(t) of the LTIC systems. In other words, the Laplace 
transform of the output signal is obtained by multiplying the Laplace transforms 
of the input signal and the impulse response. The procedure for calculating the 
output y(t) of an LTI system in the complex s-domain, therefore, consists of 
the following four steps. 

(1) Calculate the Laplace transform X(s) of the input signal x(t). If the input 
signal and the impulse response are both causal functions, then the unilateral 
Laplace transform is used. If either of the two functions is non-causal, the 
bilateral Laplace transform must be used. 

(2) Calculate the Laplace transform H(s) of the impulse response hit) of the 
LTIC system. The Laplace transform / / is ) is referred to as the Laplace 
transfer function of the LTIC system and provides a meaningful insight 
into the behavior of the system. 

(3) Based on the convolution property, the Laplace transform Y ( 5 ) of the output 
response y(t) is given by the product of the Laplace transforms of the input 
signal and the impulse response of the LTIC systems. Mathematically, this 
implies that Y (s) — X(s)H(s). 

(4) Calculate the output response y(t ) in the time domain by taking the inverse 
Laplace transform of Y (s) obtained in step (3). 
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Since the Laplace-transform-based approach for calculating the output response 
of an LTIC system does not involve integration, it is preferred over the time- 
domain approaches. 

Example 6.14 

In Example 3.6, we showed that in response to the input signal x(t) — e~'u(t), 
the LTIC system with the impulse response h(t) — er 2, u{t ) produces the 
following output: 

y(t) = (e“' - Q~ 2, )u{t). 

Example 5.21 derived the result using the CTFT. We now derive the result using 
the Laplace transform. 


Solution 

Since the input signal and impulse response are both causal functions, we 
take the unilateral Laplace transform of both signals. Based on Table 6.1, the 
resulting transform pairs are given by 

x(t) = e~'«(f) *0) = j-j-j with ROC: Re{s} > -1 


and 


h(t) = e 2t u(t) 


X(s) = 


1 

0 + 2) 


with ROC: ReOJ > —2. 


Based on the time-convolution property, the Laplace transform Y (s) of the 
resulting output y(t) is given by 

y{t) = h(t)*x(t) Y(s) = ' with ROC: ReM > -1, 

0 + 1)0 + 2 ) 


where the ROC of the Laplace transform of the output is obtained by taking the 
intersection of the regions Re{,s} > — 1 and Re { v } > —2, associated with the 
applied input and the impulse response. Using partial fraction expansion, Y (s) 
may be expressed as follows: 


Y(s) = 


1 

0 + D 

ROC : Re{s}> — 1 


1 

0 + 2) 

ROC:Re(j)>-2 


Taking the inverse Laplace transform of the individual terms on the right-hand 
side of this equation yields 

y(t) = (e -f - e” 2 ')«(r), 


which is the same as the result produced by direct convolution and the approach 
based on the CTFT time-convolution property. 
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6.4.8 Initial- and final-value theorems 

\fx(t) X(s ) with ROC: A 1 , then 

initial-value theorem x(0 + ) = lim x(t) = lim sX(s) provided x(0 + ) exists; 

7 -^ 0 + s-^-oo 

(6.27) 

final-value theorem x(oo) = lim x(t) = lim sX(s) provided x(oo) exists. 

l-s>oo S^O 

(6.28) 

The initial-value theorem is valid only for the unilateral Laplace transform 
as it requires the reference signal x(t ) to be zero for t < 0. In addition, x(t) 
should not contain an impulse function or any other higher-order discontinuities 
at t — 0. The second constraint is required to ensure a unique value of x(t) at 
t = 0 + . However, the final -value theorem may be used with either the unilateral 
or bilateral Laplace transform. The proof of these theorems is left as an exercise 
for the reader (see Problems 6.8 and 6.9). 


Example 6.15 

Calculate the initial and final values of the functions X\(t), xo (0, and -CO, 
whose Laplace transforms are specified below: 

s 4- 3 

(i) ^(s) = with ROC Ri: Refs} > 0; 

s(s + l)(s + 2) 

® = ,3 + 5 ,*+l 7 ., + 13 Wi,h R0C Re{sl > - 1; 

(iii) X 3 (s) = — with ROC R 3 : Refs} > 0. 

s 2 + 25 


Solution 

(i) Applying the initial- value theorem, Eq. (6.27), to X i (s), we obtain 


Xi(0 + ) = lim X\ (t) = lim sAi(s) = lim 


s(s + 3) 


»o+ 


= lim 


.5^00 s(s + l)(s + 2) 


(s + 3) 


s->°° (s + l)(s + 2) 


= 0 . 


Applying the final-value theorem, Eq. (6.28), to 3 (s) yields 

s(s + 3) 

*i(oo) = lim xi (t) = limtXi(s) = lim — — — — — — 

'->■ oo s—>0 s—>0 s(s + l)(s + 2) 


(s + 3) 

= lim 

(s -f- 1)(S ~b 2) 


= 1.5. 


These initial and final values of x(t) can be verified from the following inverse 
Laplace transform of X \ (s') derived in Example 6.7(i): 


X! (t) = (1.5 - 2e“ f + 0.5e~ 2, )u(t). 
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(ii) Applying the initial-value theorem, Eq. (6.27), to X 2 (s), we obtain 

s(s + 5) 


X2(0 ) = lint X 2 (t) — lim 5 X 2 ( 5 ) = lim 


f^0+ 

2 

= lim — = 0. 

s-> OO 65 


s^oo s 3 + 55 2 + 175 + 13 


Applying the final-value theorem, Eq. (6.28), to X 2 (s) yields 

5(5 + 5) 

* 2 ( 00 ) = hm x 2 (t) = lim 5 X 2 ( 5 ) = lim 

OO s—>0 s->0 5 3 + 55 2 + 175 + 13 


= 0 . 


The initial and final values of x(t) can be verified from the following inverse 
Laplace transform of X 1 ( 5 ) derived in Example 6.7(ii): 


X\(t) = (0.4e ' — 0.4e 2r cos(3 1) + 0.2e 2t sin(3 t))u(t). 


(iii) Applying the initial-value theorem, Eq. (6.27), to X 3 ( 5 ), we obtain 

, 55 5 

23 (0) = lim X3 (t) = lim 5X3(5) = lim — — — = lim — = 0. 

f-s>0+ s->oo s^oo S z + 25 *-*• OO 2 5 

Applying the final-value theorem, Eq. (6.28), to X 3 ( 5 ) yields 

55 

2:3(00) = lim *3(0 = lim 5 X 3 ( 5 ) = lim — = 0. 

00 j — >0 >0 5 2 -)- 25 

To confirm the initial and final values obtained in (iii), we determine these values 
directly from the inverse transform of X3 (5) = 5 /(s 2 + 25). From Table 6.1, the 
inverse Laplace transform of X 3 ( 5 ) is given by 23 (f) = sin(5 t)u(t). Substituting 
t = 0 + , the initial value X 3 ( 0 + ) = 0, which verifies the value determined from 
the initial-value theorem. Applying the limit t -» 00 to x 2 (t), the final value 
of x 2 (t) cannot be determined due to the oscillatory behavior of the sinusoidal 
wave. As a result, the final-value theorem provides an erroneous answer. The 
discrepancy between the result obtained from the final-value theorem and the 
actual value 2:3(00) occurs because the point 5 = 0 is not included in the ROC 
of 5X3(5) R 3 : Re{ 5 } > 0. As such, the expression for the Laplace transform 
5X3(5) is not valid for 5 = 0. In such cases, the final-value theorem cannot be 
used to determine the value of the function as f — > 00. Similarly, the point 
5 = 00 must be present within the ROC of 5X3(5) to apply the initial-value 
theorem. 


6.5 Solution of differential equations 


An important application of the Laplace transform is to solve linear, constant- 
coefficient differential equations. In Section 3.1, we used a time-domain 
approach to obtain the zero-input, zero-state, and overall solution of differ- 
ential equations. In this section, we discuss an alternative approach based on 
the Laplace transform. We illustrate the steps involved in the Laplace-transform- 
based approach through Examples 6.16 and 6.17. 
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Example 6.16 

In Example 3.2, we calculated the output voltage y(t ) across resistor R = 5 Q. 
of an RC series circuit, which is modeled by the linear, constant-coefficient 
differential equation 

dv cLv 

— + 4 y(t) = — (6.29) 

dr dr 

for an initial condition y(0~) = 2 V and a sinusoidal voltage x(t) = sin(2 t)u(t) 
applied at the input of the RC circuit. Repeat Example 3.2 using the Laplace- 
transform-based approach. 

Solution 


Overall response To compute the overall response of the RC circuit, we take 
the Laplace transform of each term on both sides of Eq. (6.29). The Laplace 
transform X (s) of the input signal x(t) is given by 

X{s) = L{x(t ) } = L{sin(2r)«(r)} = 

s l + 4 


Using the time-differentiation property, 


L 



= sX(s) - *(0") = 


2s 

s 2 + 4 


Expressed in terms of the Laplace transform pair, y(t ) < — > 7 (s), the transform 
of the first derivative of y(t) is given by 


L 



= sY (s) — y(0 _ ) = sT (s) — 2. 


Taking the Laplace transform of Eq. (6.29) and substituting the above values 
yields 

[s7(s)-2] + 47(s)= (6.30) 

s 2 + 4 

Rearranging and collecting the terms corresponding to 7 (s) on the left-hand 
side of the equation results in the following: 

[s + 4]7 (s) = 2 4 — t~~~. 


or 


7(s) = 


2 s 2 + 2s + 8 
(s + 4)(s 2 + 4) 


A Bs -|- C 
(s + 4) + (s 2 + 4) ’ 


(6.31) 


where Eq. (6.31) is obtained by the partial fraction expansion. The partial 
fraction coefficient A is given by 


( 5 + 4 ) 


2 s 2 + 2s + 8 
(s + 4)(s 2 + 4) 


s=— 4 


32 

= — = 1 . 6 . 
20 


A = 
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To obtain the values of the partial fraction coefficients B and C , we multiply 
both sides ofEq. (6.31) by (5 + 4)(s 2 + 4) and substitute A = 1.6. The re suiting 
expression is as follows: 

2s 2 + 2s + 8 = A(s 2 + 4) + (s + 4 )(Bs + C) 

= (A + B)s 2 + (4 B + C)s + 4 (A + C) 

= (1.6 + B)s 2 + (4 B + C)s + 4(1.6 + C). 

Comparing the coefficients of s 2 , we obtain 1.6 + B = 2, or B = 0.4. Similarly, 
comparing the coefficients of 5 gives 4 B + C = 2, or C — 0.4. The expression 
for Y (s) is, therefore, given by 

1.6 s 2 


Y(s) = , L6 „ + ^ + °' 4 


0.4- 


(s + 4) (s 2 + 4) (s + 4) ' (s 2 + 4) 

which has the following inverse Laplace transform: 


0.2 


(s 2 + 4) 


y(t) = [ 1 .6e + 0.4cos(2f) + 0.2 sin(2f)]«(f). 

The aforementioned value of the overall output signal is same as the solution 
derived in Eq. (3.10) using the time-domain approach. We now proceed with 
the calculation of the zero-input response y z \{t) and zero-state response y zs (t). 


Zero-input response To obtain the zero-input response y z i (0, we assume that 
the value of input x{t) = 0 in Eq. (6.29), i.e. 

+ 4y Z i(f) = 0. 
dr 

Taking the Laplace transform of the above equation and substituting: 

^ ] = sYn(s) - y zi (0~) = sT zi (s) - 2, 


gives 


which reduces to 


[s + 4]T zi (s) = 2, 
2 

Y zi (s) = 


s + 4 

Taking the inverse Laplace transform results in the following expression for the 
zero-input response: 

y zi (r) = 2e~ 4, «(0, 

which is same as the result derived in Example 3.2. 


Zero-state response To obtain the zero-state response, we assume that the 
initial condition y zs (0~) = 0. This changes the value of the Laplace transform 
of the first derivative of y(t) as follows: 

dy : 


\ = sYJs) - y zs (0~) = sY zs (s). 
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Taking the Laplace transform of Eq. (6.29) yields 
(s + 4)T zs (s) = 


s 2 + 4 


Using the partial fraction expansion, the above equation is expressed as follows: 


i'zsW = 


2s 


0.4 


+ 


0.4s + 0.4 


(s + 4)(s 2 + 4) (s + 4) (s 2 + 4) 

Taking the inverse Laplace transform, the zero-state response is given by 

y (t) = [— 0.4e~ 4r + 0.4cos(2r) + 0.2sin(2 t)]u(t), 


which is same as the result derived in Example 3.2. 

We also know from Chapter 3 that the overall response y(t) is the sum of 
the zero-input response y n (t) and the zero-state response y zs (t). This is easily 
verifiable for the above results. 


Example 6.17 

In Example 3.3, the following differential equation 

d 2 H’ dm 

-TT + 7— + 12w(0 = 12 x(t) (6.32) 

at 1 dr 

was used to model the RLC series circuit shown in Fig. 3.1. Determine the 
zero-input, zero-state, and overall response of the system produced by the input 
x{t) = 2 er'u{t) given the initial conditions, w(0“) = 5 V and vi'(0~) = 0. 

Solution 


Overall response The Laplace transforms of the individual terms in Eq. (6.32) 
are given by 


X(s) = L{x(r)} = L{2 e-'n(f)} = 
W(s) = L{w(r)}, 


5 + 1 ’ 


^ } = sW(s) - w ( 0“ ) = sW(s) - 5, 


and 


L 


d 2 w 

dr 2 


= 5 2 W(5) - sw(0“) - w(0“) = 5 2 W(5) - 5s. 


Taking the Laplace transform of both sides of Eq. (6.32) and substituting the 
above values yields 

24 

[v 2 W(i) - 5s] + 7[sW(s) - 5] + 12 W(s) = 

s + 1 


or 


[s 2 + 7s + 12]W(s) = 5s + 35 + 


24 
s + 1 


5s 2 + 40s + 59 


s + 1 
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which reduces to 


W(s) = 


5 s 2 + 40.s + 59 
(5+ 1)(5 2 + 75 + 12) 


5 5 2 + 405 + 59 
(5 + l)(5 + 3)(5 + 4)' 


Taking the partial fraction expansion, we obtain 

55 2 + 405 + 59 _ ki k 2 , k 3 

( 5 + l)(5 + 3)(5 + 4) : (5+ 1) + (5 + 3) + (5 + 4)’ 


where the partial fraction coefficients are given by 


k\ — 
k-2 = 


5 5 2 + 405 + 59 ' 

{s + 1 ) 

y (5+l)(^ + 3)(5 + 4)J 5= _ 1 

„ 55 2 + 405 + 59 ' 

; (5+ 1)(5 + 3)(5 + 4)J j= _3 


5 - 40 + 59 _ 
(2X3) " 

45 - 120 + 59 
(—2X1) 


and 


h 


55 2 + 405 + 59 

(5 + 4 ) 

(5+ 1)(5 + 3)(5 + 4 )J j= _ 4 


80- 160 + 59 
( — 3)( — 1) 


-7. 


Substituting the values of the partial fraction coefficients k\, kn, and k ) , we 
obtain 

4 8 7 

= I 

(5+1) (5 + 3) (5 + 4)’ 

Calculating the inverse Laplace transform of both sides, we obtain the output 
signal as follows: 


w(t) = [4e“ f + 8e~ 3 ' - 7e~ 4 ' ];/(?). 


Zero-input response To calculate the zero-input output, the input signal is 
assumed to be zero. Equation (6.32) reduces to 


d 2 w 7 j dw 7 ; 

+ 7 — 2 

dr 2 dr 


+ 12w zi (r) — 0, 


(6.33) 


with initial conditions w(0 ) = 5 and vi>(0 ) = 0. Calculating the Laplace 
transform of Eq. 6.33 yields 


[5 2 W zi (5) - 55] + 7[5lT z i(5) - 5] + \2W zi (s) = 0 


or 


W zi (s) = 


5 5 + 35 
5 2 + 7.s+ 12' 


Using the partial fraction expansion, the above equation is expressed as follows: 

7 , 55 + 35 20 15 

Vk zi (5) = 


5 2 + 75 + 12 5 + 3 5 + 4 

Taking the inverse Laplace transform, the zero-input response is given by 


Wait) = [20e _3f - 15e 4/ ]«(r). 
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Zero-state response To calculate the zero-state output, the initial conditions 
are assumed to be zero, i.e. H’(0 - ) = 0 and vf(0 _ ) = 0. Taking the Laplace 
transform Eq. (6.31) and applying zero initial conditions yields 

24 

s 2 W zs (s) + 7slT zs (s) + 12W zs (s) = - 

5 + 1 

or 

24 

W zs (s) = . 

(s + l)(s 2 + Is + 12) 

Using the partial fraction expansion, we obtain 

24 4 12 8 

zsW (s+ l)(s + 3)(s + 4) (s+1) (s + 3) (s+4)' 

Taking the inverse Laplace transform, the zero-state response of the system is 
given by 

w zs (t) = [4e - ' - 12e- 3 ' + 8 e 4? ]z<(r). 


The overall, zero-input, and zero-state responses calculated in the Laplace 
domain are the same as the results computed in Example 3.3 using the time- 
domain approach 


A direct consequence of solving a linear, constant-coefficient differential equa- 
tion is the evaluation of the Laplace transfer function 1 1 (s) for the LTIC system. 
The Laplace transfer function is defined as the ratio of the Laplace transform 
Y (s) of the output signal y(t) to the Laplace transform X (s ) of the input signal 
x{t). Mathematically, 


H(s) = 


Y(s) 

X(s)’ 


(6.34) 


which is obtained by taking the Laplace transform of the differential equation 
and solving for H(s), as defined in Eq. (6.34). The above procedure provides 
an algebraic expression for the Laplace transfer function. Its ROC is obtained 
by observing whether the LTIC is causal or non-causal. Given the algebraic 
expression and the ROC, the inverse Laplace transform of the Laplace transfer 
function H(s) leads to the impulse response h(t) of the LTIC system. The 
Laplace transfer function is also useful for analyzing the stability of the LTIC 
systems, which is considered in Sections 6.6 and 6.7. 


6.6 Characteristic equation, zeros, and poles 


In this section, we will define the key concepts related to the stability of LTIC 
systems. Although these concepts can be applied to general LTIC systems, we 
will assume a system with a rational transfer function H(s ) of the following 
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form: 


X(s) = 


N(s) 

D(s) 


b m s m + b m -!S m - 1 + b m - 2 S m ~ 2 + --- + b lS + bo 
s n + + a„_ 2 s n ~ 2 H h a { s + a 0 


Characteristic equation The characteristic equation for the transfer function 
in Eq. (6.35) is defined as follows: 

D(s) = s n + u n —\S n ^ T a n - 2 s n T • • • T Q\S T gq — 0. (6.36) 

It will be shown later that the characteristic equation determines the behavior 
of the system, including its stability and possible modes of the output response. 
In other words, it characterizes the system very well. 


Zeros The zeros of the transfer function / / (s ) of an LTIC system are the finite 
locations in the complex s-plane where |//(s)| = 0. For the transfer function in 
Eq. (6.35), the location of the zeros can be obtained by solving the following 
equation: 

N(s) = b m s m + bm-is”- 1 + b m — 2 s m ~ 2 + -.. + b lS + bo = 0. (6.37) 

Since /V (s ) is an wth-order polynomial, it will have m roots leading to m zeros 
for transfer function //(,sj. 


Poles The poles of the transfer function II (s) of an LTIC system are the loca- 
tions in the complex s-plane where |//(i)| has an infinite value. At these loca- 
tions, the Laplace magnitude spectrum takes the form of poles (due to the infinite 
value), and this is the reason the term “pole” is used to denote such locations. 
The poles corresponding to the transfer function in Eq. (6.35) can be obtained 
by solving the characteristic equation, Eq. (6.36). 

Because D(s) is an nth-order polynomial, it will have n roots leading to n 
poles. In order to calculate the zeros and poles, a transfer function is factorized 
and typically represented as follows: 


H(s) = 


N(s) 

D(s) 


b m (s - zi)(5 - z 2 ) • • ■ (s - z m ) 
(s - Pi)(s - p 2 ) ■ ■ ■ (s - p n ) 


(6.38) 


Note that a transfer function H(s) must be finite within its ROC. On the other 
hand, the magnitude of the transfer function H(s ) is infinite at the location of a 
pole. Therefore, the ROC of a system must not include any pole. However, an 
ROC may contain any number of zeros. 


Example 6.18 

Determine the poles and zeros of the following LTIC systems: 


(i) 

(ii) 


Hds) 


(s + 4)(s + 5) _ 
s 2 (s + 2)(s — 2)’ 


H 2 (s) = 


(s + 4) 

+ 5s 2 + m-f 13’ 


(iii) 


H 2 (s) = 


1 

e 1 + 10' 
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Fig. 6.8. Locations of zeros and 
poles of LTIC systems specified 
in Example 6.18. The ROCs for 
causal LTIC systems are 
highlighted by the shaded 
regions. Parts (a)-(c) correspond 
to parts (i)-(iii) of Example 6.18. 


Im{s} Im{i} 



(a) 


(b) 


Im{s} 




j37T 



JJC 

r* 

^f- 

1 

'•O 

1 

oo 

2 0 

.2 4 6 8 

-J x 



-]3k 


(c) 


Solution 

(i) The zeros are the roots of the quadratic equation ( s + 4)(s + 5) = 0, which 
are given by s = —4, —5. The poles are the roots of the fourth-order equation 
s 2 (s + 2 )(s — 2) = 0, and are given by s — 0, 0, —2, 2. Figure 6.8(a) plots the 
location of poles and zeros in the complex s-plane. The poles are denoted by 
the “x” symbols, while the zeros are denoted by the “o” symbols. 

(ii) The zeros are the roots of the equation 5+4 = 0, which are given by 
5 = —4. The poles are the roots of the third-order equation 5 3 + 5.v 2 + 175 + 
13 = 0, and are given by s = — 1, —2 ± j3. Figure 6.8(b) plots the location of 
poles and zeros in the complex s-plane. 

(iii) Since the numerator is a constant, there is no zero for the LTIC system. 
The poles are the roots of the characteristic equation e s + 0.1 = 0. Following 
the procedure shown in Appendix B, it can be shown that there are an infinite 
number of roots for the equation e s +0.1 =0. The locations of the poles are 
given by 


5 = In 0.1 + j(2 m + 1 )jt & —2.3 + j(2m + 1 )tt. 
The poles are plotted in Fig. 6.8(c). 


6.7 Properties of the ROC 


In Section 3.7.2, we showed that the impulse response h(t) of a causal LTIC 
system satisfies the following condition: 


h(t) = 0 for t < 0. 
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For such right-sided functions, it is straightforward to show that the ROC R of 
its transfer function H(s) will be of the form Re{.y } > <to, containing the right 
side of the s-plane. Consider, for example, the bilateral Laplace transform pairs 

e~ a ‘u(t ) <--> with ROC: Re{s} > —a 


— e at u{ — t) with ROC: Refi} < —a. 

s + a 

The first function &~ a, u(t) is right sided and its ROC: Re{s} > —a occupies the 
right side of the s-plane. On the other hand, the second function —eT a 'u(—t) is 
left sided, and its ROC: Re{,v} < —a occupies the left side of the s-plane. Based 
on the above observations and the Laplace transform pairs listed in Table 6.1, 
we state the following properties for the ROC. 

Property 1 The ROC consists of 2D strips that are parallel to the imaginary 
jcu-axis. 

Property 2 For a right-sided function, the ROC takes the form Re{i} > cro 
and consists of the right side of the complex s-plane. 

Property 3 For a left-sided function, the ROC takes the form Re{,s } < cro and 
consists of the most of the left side of the complex s-plane. 
Property 4 For a finite duration function, the ROC consists of the entire s-plane 
except for the possible deletion of the point s = 0. 

Property 5 For a double-sided function, the ROC takes the form o\ < Re{s} < 
ai and is a confined strip within the complex s-plane. 

Property 6 The ROC of a rational transfer function does not contain any pole. 

Combining Property 6 with the causality constraint (Re{s) > cr 0 ) discussed 
earlier in the section, we obtain the following condition for a causal LTIC 
system. 

Property 7 The ROC R for a right-sided LTIC system with the rational transfer 
function H(s) is given by R: Re{s} > Re{ p r }, where p r is the 
location of the rightmost pole among the n poles determined using 
Eq. (6.36). 

Since the impulse response of a causal system is a right-sided function, the 
ROC of a causal system satisfies Property 7. The converse of Property 7 leads 
to Property 8 for a left-sided sequence. 

Property 8 The ROC R for a left-sided function with the rational transfer func- 
tion H(s) is given by R: Rej.v} < Re{ p\ } where p\ is the leftmost 
pole among the n poles determined using Eq. (6.36). 

To illustrate the application of the properties of the ROC, we consider the 
following example. 
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Example 6.19 

Consider the LTIC systems in Example 6. 1 8(i) and (ii). Calculate the impulse 
response if the specified LTIC systems are causal. Repeat for non-causal 
systems. 


Solution 

(i) Using the partial fraction expansion, H\(s) can be expressed as follows: 

H (s \ _ + 5 ) = b. + + k 3 + kA 

1 ‘ 9 ~~ s 2 (s + 2)(s -2)~ s + s 2 + (s + 2) + (s - 2)’ 

where 


r d / (s + 4)(s + 5)\1 


"25 + 9 

(5+4)(5 + 5) a ] 

_ds \{s + 2)(s-2)J_ 

.5=0 

to 

1 

-1^ 

( 5 2 - 4) 2 M 


h 


' 2 (s + 4)(s + 5) I _ (4) (5) 
S .S' 2 (.t + 2)(s - 2) J s=0 2( — 2) 


and 


h 


is + 2) 


(s + 4)(s + 5) 
s 2 (s + 2 )(s - 2) 


s=— 2 


(2X3) 
4(— 4) 


3 

8 ’ 


k A 


(s + 4)(s + 5) 

s 2 (s + 2)U-2)J j=2 


(6X7) = 21 
4(4) 8 ’ 


Therefore, 


9 5 3 21 

//l( ‘ S) = ~4s ~ s 2 ~ 8(s + 2) + 8(s - 2)' 


If Hi(s) represents a causal LTIC system, then its ROC, based on Property 7, 
is given by R c : Rej.s' | > 2. Based on the linearity property, the overall ROC R c 
is only possible if the ROCs for the individual terms in Hi(s) are given by 


Hds) 


9 5 3 21 



ROC:Re(.!)>0 



ROC:Re{i}>0 


8 (S + 2) 

ROC:Re{s}>-2 


8 (S - 2) ' 

ROC:Rej.s)>2 


By calculating the inverse Laplace transform, the impulse response for a causal 
LTIC system is obtained as follows: 


MO 



H(t). 


If //i(0 represents a non-causal system, then its ROC can have three different 
values: Re-jT) < —2; —2 < Refs} < 0;or0 < Refs} < 2 in the s-plane. Select- 
ing Re{.v) < —2 as the ROC will lead to a left-sided signal. The remaining two 
choices will lead to a double-sided signal. Assuming that we select the overall 
ROC to be R nc : Re{.t) < —2 , the ROCs for the individual terms in H\(s) are 
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given by 


4 s 


21 


8(5 + 2) 8(5 - 2) 


ROC:Re(i)<0 ROC:Re{j)<0 ROC:Re(.s)<-2 ROC:Re{i}<2 

Taking the inverse Laplace transform, the impulse response for a non-causal 
LTIC system is given by 


hi(t) = 


9 c 3 _ 2 , 21 ' 

- + 5t + -e 2 e 2 

4 8 8 


u(-t). 


(ii) Using the partial fraction expansion, 7/2(5) may be expressed as follows: 

3 35 -1 

H 2 (s) = 


10(5 + 1) 10(5 2 + 45 + 13)' 

If //2U) represents a causal system, then its ROC is given by R c : Re{5} > — 1. 
The ROCs associated with the individual terms in H 2 (s) are given by 

3 35 -1 

7 / 2 ( 5 ) = 


10(5 + 1) 

ROC:Re{j)>-l 


10(5 2 + 45 + 13) 

V* ^ 

ROC:Re{s)>-2 


Taking the inverse Laplace transform, the impulse response for a causal LTIC 
system is given by 


* 2(0 = 




cos(3t) H e 

30 


sin(3f) 


u(t). 


If 7/2(5) represents a non-causal system, then several different choices of ROC 
are possible. One possible choice is given by R nc : Re{5) < —2. The ROCs 
associated with the individual terms in 7/2(5) are given by 


7/2(5) = 


3 

10(5+1) 


ROC:Re{j)<-l 


35 - 1 

10(5 2 + 4.V+ 13) ' 

V* ^ 

ROC:Re{s)<-2 


Taking the inverse Laplace transform, the impulse response for a causal LTIC 
system is given by 


* 2(0 = 



3 7 

— e~ 2t cos(3 0 e _2f sin(3f) 

10 30 


«(- 0 - 


6.8 Stable and causal LTIC systems 


In Section 3.7.3, we showed that the impulse response h(t) of a BIBO stable 
system satisfies the condition 

00 

1 \h(t)\dt < 00 . 

— OO 


(6.39) 
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In this section, we derive an equivalent condition to determine the stability of 
an LTIC system modeled with a rational Laplace transfer function H(s) given 
in Eq. (6.35). Since we are mostly interested in causal systems, we assume 
that the Laplace transfer function H(s ) corresponds to a right-sided system. 
The poles of a system with a transfer function as given in Eq. (6.35) can be 
calculated by solving the characteristic equation, Eq. (6.36). Three types of 
poles are possible. Out of the n possible poles, assume that there are L poles at 
s = 0, K real poles at s = — o>, 1 < k < K, and M pairs of complex-conjugate 
poles at s = —a m ± j co m , 1 < m < M, such that L + K + 2 M — n. In terms 
of its poles, the transfer function, Eq. (6.35), is given by 


H(s) = 


N(s) 

D(s) 


N(s) 

K M 

S L n (s + Cft) Yi l* 2 + 2a ™ s + (“m + W m)) 

k= 1 m—l 


(6.40) 


From Table 6.1, the repeated roots at s = 0 correspond to the following term 
in the time domain: 


1 

n ! 


t"u(t) 


1 

s n 


(6.41) 


Since term t n u(t ) is unbounded as t — > oo, a stable LTIC system will not contain 
such unstable terms. Therefore, we assume that L — 0. The partial fraction 
expansion of Eq. (6.40) with L — 0 results in the following expression: 


H(s) = 


A i 

(S + CTl) 


B m s 


(s + a K ) 
- Cm 


+ 


B\S + C i 

(s 2 + 2a [S + + tu 2 )) 


(^ 2 + 2 a M s + (cr M + a ? M )) 


(6.42) 


where { Aj . , B m , C m } are the partial fraction coefficients. Calculating the inverse 
Laplace transform of Eq. (6.42) and assuming a causal system, we obtain the 
following expression for the impulse response h(t) of the LTIC system: 


h{t) = 'Y2 Ate ak, ujt) + ^ )-„,e cos (co m t + 9 m ) ujt), 


(6.43) 


k= 1 


ht(t) 


m = 1 


h m (t) 


where we have expressed the terms with conjugate poles in the polar format. 
Constants {r m , 0 „, } are determined from the values of the partial fraction coef- 
ficients {B m , C„,} and a m . 

In Eq. (6.43), we have two types of terms on the right-hand side of the 
equation. Summation I consists of K real exponential functions of the type 
hk{t) = A l: exp(—(T k t )u(t ). Depending upon the value of o k , each of these func- 
tions hk(t) may have a constant, decaying exponential or a rising exponential 
waveform. 

Summation II consists of exponentially modulated sinusoidal functions of 
the type h m (t) = r„, exp (—a m t) cos (oo m t + Q m )u{t). The stability characteristic 
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Fig. 6.9. Nature of the shape of 
the terms hk(t) and h m (t) for 
different sets of values for 
a k and a m . For real-valued 
coefficients b n in D(s), the 
complex poles occur as 
complex-conjugate pairs. 


Im{s} 



of the functions h m {t) included in the second summation depends upon the 
value of a m . To illustrate the effect of the values of 07 and a„, on the stability of 
the LTIC system, Fig. 6.9 plots the shape of the waveforms in the time domain 
corresponding to terms hi-(t) and h m (t) for different sets of values for 07 and 
a m . The three plots along the real axis, Re{.y }, at coordinates (— 07, 0), (0, 0), 
and (07 , 0) represent the terms hi (t ) in summation I. For / 1 (s) to correspond to 
a stable LTIC system, each of the terms in Eq. (6.43) should satisfy the stability 
condition, Eq. (6.39). Clearly, terms hk{t) = Af : exp(—cri : t)u(t) are stable if 
Ok > 0, where terms h/, : (t) would correspond to decaying exponential functions. 
In the three cases plotted along the real axis in Fig. 6.9, this is observed by the 
impulse response /q-(f ) at coordinate (— 07 , 0). In other words, summation I will 
be stable if the value of eq- in term lu (t) = Ak exp (-Okt)u(t) is positive. The 
real roots .v = —07, for 1 < k < K, must therefore lie in the left-half s-plane 
for summation I to be stable. 

Similarly, term h m (t) = r m exp(— a m t) cos(co m t + 6 m )u(t) in summation II 
is stable if a m > 0, where h m (t) would correspond to a decaying sinusoidal 
waveform. This is evident from the remaining six coordinates selected in 
Fig. 6.9. If the value of a m in term = r m exp(— a m t) cos(cu m f + 9 m )u(t) 
is set to a negative value, corresponding to the two impulse responses h m (t) 
at coordinates (oq, a>{) and (a 1; 2a>{), term h m (t) corresponds to an unstable 
waveform. Only when the value of a m is set to be positive, corresponding 
to the waveforms at coordinates (—a 1, co\) and (— ai, is term h m (t) 

stable. This implies that the location of the complex poles s = ±j&> m , 

1 < m < M, should also lie in the left-half s-plane for the LTIC system to be 
stable. Based on the above discussion, we state the following conditions for 
the stability of the LTIC systems with causal implementation for the impulse 
responses. 
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Property 9 A causal LTIC system with n poles {pi}, 1 < / < n, will be abso- 
lutely BIBO stable if and only if the real part of all poles are 
non-zero negative numbers, i.e. if 

Re{p/} < 0 for all /. (6.44) 

Equation (6.44) states that a causal LTIC system will be absolutely BIBO stable 
if and only if all of its poles lie in the left half of the s-plane, (i.e. to the left of the 
j&>-axis). In other words, a causal LTIC system will be absolutely BIBO stable 
and causal if the ROC occupies the entire right half of the s-plane including the 
jcu-axis. 

We illustrate the application of the stability condition in Eq. (6.44) in Example 

6 . 20 . 


Example 6.20 

In Example 6.18, we considered the following LTIC systems: 


(i) 

(ii) 

(iii) 


H i(j) = 


H 2 (s) = 


H 3 (s) = 


(j + 4)(s + 5) . 
s 2 (s +2)(s - 2)’ 

(J + 4) 

s 3 + 55 2 + 17.S+ 13’ 

1 

e s + 10' 


Assuming that the systems are causal, determine if the systems are BIBO stable. 


Solution 

(i) The LTIC system with transfer function Hi(s) has four poles located at 
s = —2, 0, 0, 2. Since all the poles do not lie in the left half of the s-plane, 
the transfer function does not represent an absolutely BIBO stable and causal 
system. The impulse response of the causal implementation of the LTIC system 
was calculated in Example 6.19. It can be easily verified that the time-domain 
stability condition, Eq. (6.39), is not satisfied because of the rising exponential 
function 21/8 exp(2t)u(t ) and the ramp function 5 1, which have infinite areas. 

(ii) The LTIC system with transfer function H 2 (s) has three poles located 
at s = — 1, —2 ± j3. Since all the poles lie in the left-half s-plane, the transfer 
function represents an absolutely BIBO stable and causal system. The impulse 
response of the causal implementation of the LTIC system was calculated in 
Example 6. 1 9. It can be easily verified that the time-domain stability condition, 
Eq. (6.39), is satisfied as all terms are decaying exponential functions with finite 
areas. 

(iii) The LTIC system with transfer function H 2 (s) has multiple poles located 
at s = —2.3 + j(2 m + l)jr, form = 0, ±1, ±2, . . . Since all the poles lie in the 
left-half s-plane, the transfer function represents an absolutely BIBO stable and 
causal system. 
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6.8.1 Marginal stability 

In our previous discussion, we considered absolutely stable and unstable sys- 
tems. An absolutely stable system has all the poles in the left half of the complex 
s-plane. A causal implementation of such a system is stable in the sense that 
as long as the input is bounded, the system produces a bounded output. On 
the contrary, an absolutely unstable system has one or more poles in the right 
half of the complex s-plane. The impulse response of a causal implementation 
of such a system includes a growing exponential function, making the system 
unstable. An intermediate case arises when a system has unrepeated poles on 
the imaginary jw-axis. The remaining poles are in the left half of the complex s- 
plane. Such a system is referred to as a marginally stable system. The condition 
for marginally stable system is stated below. 


Property 10 An LTIC system, with K unrepeated poles ,s> = ja>*, 1 < k < K, 
on the imaginary jcu-axis and all remaining poles in the left-half s-plane, is 
stable for all bounded input signals that do not include complex exponential 
terms of the form exp(— jco^t), for 1 < k < K. If the poles on the imaginary 
ja>-axis are repeated, then the LTIC system is unstable. 

The following example demonstrates that a marginally stable system becomes 
unstable if the input signal includes a complex exponential exp(— jtooO with 
frequency coo corresponding to coordinate s = }coq of the location of the pole 
of the system on the imaginary jcn-axis in the complex s-plane. 


Example 6.21 

Consider an LTIC system with transfer function 


H(s) = 


25 

s 2 + 25 


representing a marginally stable system. Determine the output of the LTIC 
system for the following inputs: 


(i) xi (t) = u(t); 

(ii) X 2 (t) = sin(5 t)u(t). 


Solution 

(i) Taking the Laplace transform of the input gives X \ (s) = 1 /s. The Laplace 
transform of the output is given by 


Y l (s) = H(s)X 1 (s) = 


25 

s(s 2 + 25) 


1 s 

7 ~~ (s 2 + 25) 


Taking the inverse Laplace transform gives the following value of the output in 
the time domain: 


yi{t) = (1 - cos(5f))«(r). 
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(a) 

Fig. 6.10. Waveforms of the 
output signals produced by a 
marginally stable system 
resulting from 
(a) x n (f) = u(t) and (b) 
x 2 (t) = sin(5f)i/(f), as 
considered in Example 6.21. 


(b) 

As expected for a marginally stable system, the output y\{t) produced by a 
bounded input X\ (t) = u{t) in the above expression is bounded for all time t. 
Figure 6.10(a) plots the bounded output yi(?) as a function of time t. 

(ii) Taking the Laplace transform of the input gives X 2 (s) = 5/s 2 + 25. The 
Laplace transform of the output is given by 

Y 2 (.s) = H(s)X 2 (s) = , 12 ^ 3 

(s~ + 25 Y 

Using the transform pair 

1 l 1 

^(sin(at) - at cos(at))u(t) < — » + 2 , 

the output y 2 {t) in the time domain is given by 


y 2 (t) — 0.5(sin(5f) — 5t cos(5t))u(t). 

lln part (ii), a sinusoidal signal sin(5f) = (exp(j5/) — exp(— j5t ))/2j is applied 
at the input of a marginally stable system with poles located at = ±j5 on 
the imaginary jYv-axis. Note that the fundamental frequency (ojq = 5) of the 
sinusoidal input is the same as the location ( s = ±j5) of the poles in the com- 
plex s-plane. In such cases, Property 6.10 states that the resulting output y 2 (t ) 
will be unbounded. The second term —5 1 cos(5 t)u(t) indeed makes the output 
unbounded. This is illustrated in Fig. 6.10(b), where y 2 (t) is plotted as a function 
of time t. 


6.8.2 Improving stability using zeros 


To conclude our discussion on stability, let us consider an LTIC system with 
transfer function given by 


flap (S) = 


is -a- ) b) 
is + a - j b) ’ 


(6.45) 
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Fig. 6.11. Locations of poles 


Im{i} 


system in the complex s-plane. 
The ROC of the causal 


-j b O 

implementation of the allpass 
system is highlighted by the 


shaded region. 

0 

a 

having a pole at s 

— (— a + j b) and a 


-►Refs} 


Fig. 6.11, the locations of the pole and zero are symmetric about the 
imaginary j co-axis in the complex s-plane. Clearly, a causal implementa- 
tion of the transfer function ll(s) of the system will be stable as its ROC: 
Re{j) > —a includes the imaginary j co-axis. The CTFT of the LTIC system is 
evaluated as 


( jco — a — i b) 
tf«p(jfi>) = tfapO)Uj«> = ^ , 

(jco + a-jb) 


with the CTFT spectra as follows: 


J(—a) 2 + (co — b) 2 

magnitude spectrum |// ap (jco)| = — = 1; 

V (a) 2 + (co — b) 2 


phase spectrum <// ap ( jco) = tan 


-l 


co — b 


—a 


— tan 


cd — b 


a 


(6.46) 


(6.47) 

(6.48) 


Such a system is referred to as an allpass system, since it allows all frequencies 
present in the input signal to pass through the system without any attenuation. 
Of course, the phase of the input signal is affected, but in most applications we 
are more concerned about the magnitude of the signal. 

An allpass system specified in Eq. (6.45) is frequently used to stabilize an 
unstable system. Consider an LTIC system with the transfer function 


H(s) = 


Hi(s) 

(s — a — )by 


(6.49) 


where the component H\(s) is assumed to have all poles in the left half of 
the s-plane and is, therefore, stable. A causal implementation of the transfer 
function H(s) is unstable because of the existence of the term (s — a — j b) 
into the denominator. This term results in a pole at s = (a + j b) and introduces 
instability into the system. Such a system can be made stable by cascading it 
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with an allpass system that has a zero at the location of the unstable pole. The 
transfer function of the overall cascaded system is given by 

//overall(s) = //(s)//ap(s) = 7 (6.50) 

(s + a- j b) 

which is stable because the unstable pole at s = (a + j b) is canceled by the 
zero of the allpass system. The new pole at s = (—a + j b) lies in the left-half 
s-plane and satisfies the stability requirements. Note that the magnitude response 
of the overall cascaded system is the product of the magnitude responses of the 
unstable and allpass systems, and is given by 

l#overall(j«)l = \H()CO)\ |// a p(j«)l = \H{]o>)\, (6.51) 

since \H ap ()a))\ = 1. Hence, by cascading an unstable system with an allpass 
system, which has a zero at the location of the unstable pole, we have stabilized 
the system without affecting its magnitude response. The only change in the 
system is in its phase. Such a pole-zero cancelation approach is frequently 
used in applications where information is contained in the magnitude of the 
signal and the phase is relatively unimportant. One such application is the 
amplitude modulation system described in Section 2.1.3, which is used for 
radio communications. 


6.9 LTIC systems analysis using Laplace transform 


In Section 6.4.7, we showed that the output response of an LTIC system could 
be computed using the convolution property in the complex s-plane. This elim- 
inates the need to compute the computationally intense convolution integral in 
the time domain. Below, we provide another example for calculating the output 
using the Laplace transform. Our motivation in reintroducing this topic is to 
compare the Laplace-transform-based analysis technique with the CTFT-based 
approach. 


Example 6.22 

In Example 5.26, we determined the overall and steady state values of the output 
of the RC series circuit with the CTFT transfer function 


H(co) = 


1/j aC 
R T 1 /j coC 


1 

1 + j coCR 


and constant CR = 0.5 for the input signal x(t ) = sin(3?)w(f). For simplicity, we 
assumed that the capacitor is uncharged at t = 0. Here we solve the problem in 
Example 5.26 using the Laplace transform. 
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Solution 

The Laplace transform of the input signal x{t ) is given by 

X(s) = L{sin(3r)K(0} = 3 


s 2 + 9 

The Laplace transfer function of the RC series circuit is given by 
H(s) = H(w)\ ico=s = — l —— . 

I iSC/v 

Substituting the value of the product CR = 0.5 yields 

1 2 

H(s) = 


1 + 0.5 s 5 + 2 

The Laplace transform Y ( s ) of the output signal is given by 

6 6 65-12 

Y(s) = H(s)X(s) = = 

(5 + 2)(5 2 + 9) 13(5 + 2) 13(5 2 + 9) 


Y(s) = 


13(5 + 2) 13 ( 5 2 + 9) 13 ( 5 2 + 9)' 

Taking the inverse transform leads to the following expression for the overall 
output in the time domain: 


y(t) = 
u(t ) = 


6 ,, 6 4 

— e cos(3f) H sin(3f) 

13 13 13 


= - 2 1 


sin(3 1 - 56°) 


u(t). 


.13 VI3 

The steady state value of the output is computed by applying the limit t — > oo 
to the overall output: 


Vss(0 = lim y(t) = —= 
<^°° V13 


sin(3r - 56 °)u(t). 


In Chapters 5 and 6, we presented two frequency-domain approaches to analyze 
CT signals and systems. The CTFT-based approach introduced in Chapter 5 uses 
the real frequency a>, whereas the Laplace-transform-based approach uses the 
complex frequency a. Both approaches have advantages. Depending upon the 
application under consideration, the appropriate transform is selected. 

Comparing Example 6.22 with Example 5.26, the Laplace transform appears 
to be a more convenient tool for the transient analysis. For the steady state 
analysis, the Laplace transform does not seem to offer any advantage over 
the CTFT. The transient analysis is very important for applications in control 
systems, including process control and guided missiles. In signal processing 
applications, such as audio, image, and video processing, the transients are 
generally ignored. In such applications, the CTFT is sufficient to analyze the 
steady state response. This is precisely why most signal processing literature 
uses the CTFT, while the control systems literature uses the Laplace transform. 
Important applications of the Laplace transforms such as analysis of the spring 
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damper system and the modeling of the human immune system are presented 
in Chapter 8. 


6.10 Block diagram representations 


In the preceding discussion, we considered relatively elementary LTIC systems 
described by linear, constant-coefficient differential equations. Most practi- 
cal structures are more complex, consisting of a combination of several LTIC 
systems. In this section, we analyze the cascaded, parallel, and feedback con- 
figurations used to synthesize larger systems. 


6.10.1 Cascaded configuration 

A series or cascaded configuration between two systems is illustrated in 
Fig. 6.12(a). The output of the first system II \ (.v) is applied as input to the 
second system H 2 (s). Assuming that the Laplace transform of the input x(t), 
applied to the first system, is given by X (,v), the Laplace transform W (s ) of the 
output w(t) of the first system is given by 

wit) = x(t) * hi(t) W(s) = X(s)Hi(s). (6.52) 


The resulting signal w(t) is applied as input to the second system // 2 (.s), which 
leads to the following overall output: 

yit) = wit) * hi(t) ^ Y(s) = Wis)H 2 is). (6.53) 

Substituting the value of wit) from Eq. (6.52), Eq. (6.53) reduces to 

yit) = Xit) * h x it) * h 2 it) Hs) = Wis)Hiis)H 2 is). (6.54) 


In other words, the cascaded configuration is equivalent to a single LTIC system 
with transfer function 


Fig. 6.12. Cascaded 
configuration for connecting 
LTIC systems: (a) cascaded 
connection; (b) its equivalent 
single system. 


hit) = h^t) * h 2 it) His) = Hxis)H 2 is). (6.55) 

The system H(s) equivalent to the cascaded configuration is shown in 
Fig. 6.12(b). 


m 



-> m m ■ 


H(s)=H l (s)H 2 (s) 


► m 


(a) 


(b) 
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X(s) 

(a) 



X|»- 


H(s)=H l (s) + H 2 (s) 




(b) 


Fig. 6.13. Parallel configuration for connecting LTIC systems: (a) parallel connection; (b) its equivalent 
single system. 


6.10.2 Parallel configuration 

The parallel configuration between two systems is illustrated in Fig. 6.13(a). 
A single input x(t) is applied simultaneously to the two systems. The overall 
output y(t) is obtained by adding the individual outputs y\ (t) and y 2 it) of the 
two systems. The individual outputs of the two systems are given by 

system (1) y\(t) = x(t) * h\(t) T^s) = X(s)Hi(s ); (6.56) 

system (2) y 2 {t) = x(t) * h 2 (t) Yn{s) = X(s)H 2 (s). (6.57) 

Combining the two outputs, the overall output y(t) is given by 

yit) = yi(f) + y 2 (t) Y(s) = Vi(s) + Y 2 (s). (6.58) 

Substituting Eqs. (6.56) and (6.57) into the above equation yields 

y(t) = X(t) * Unit) + h 2 (t)\ T(s) = X(s)[HUs) + H 2 (s)]. (6.59) 

In other words, the parallel configuration is equivalent to a single LTIC system 
with transfer function 

h{t) = h\(t) + h 2 (t) ^ H(s ) = Hiis) + H 2 (s). (6.60) 

The parallel configuration and its equivalent single-stage system are shown in 
Fig. 6.13. 


6.10.3 Feedback configuration 

The feedback connection between two systems is shown in Fig. 6.14(a). In a 
feedback system, the overall output y(t) is applied at the input of the second 
system H 2 (s). The output w(t) of the second system is fed back into the input 
of the overall system through an adder. In terms of the applied input x(t) and 
wit), the output of the adder is given by 

Eis) = Xis)-Wis). (6.61) 

The outputs of the two LTIC systems are given by 

system (1) 7(s) = £(i)//i(s); 

system (2) Wis) = Yis)H 2 (s). 


(6.62) 

(6.63) 
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Fig. 6.14. Feedback 
configuration for connecting 
LTIC systems: (a) feedback 
connection; (b) its equivalent 
single system. 


(a) 



-► ¥(s) X(s)~ 


(b) 


tflOO 

m 1 +H 1 ( S )H 2 (S) 


* Y(s) 


Substituting the value of E(s) = Y is)/ U\(s) from Eq. (6.62) and W(s) from 
Eq. (6.63) into Eq. (6.61) yields 


Y(s) = Hds)[X(s) - H 2 (s)Y(s)]. (6.64) 

Rearranging terms containing Y (s), we obtain 

[1 + // 1 (S)// 2 ( S )]7( S ) = // 1 ( S )I(S), 


which leads to the following transfer function for the feedback system: 


H(s) = 


Y(s ) 

X(s) 


H\(s) 

l + H^H^s) ' 


(6.65) 


The feedback configuration and its equivalent single system are shown in 
Fig. 6.14. 


Example 6.23 

Determine (i) the impulse response and (ii) the transfer function of the inter- 
connected systems shown in Figs. 6.15(a)-(c). 


Solution 

(a) To calculate the overall impulse response, we proceed in the Laplace 
domain. The transfer function Hi(s) of the cascaded systems shown in the 
lower branch of the system in Fig. 6. 15(a) is given by 

//iCs) = L{8(t - 1 )}H(s) = e~ s H(s). 

The overall transfer function H a (s) is therefore given by 

H,(s) = H(s ) + Hds) = (1 + e~ s )H(s). 

Taking the inverse of the above transfer function gives the impulse response: 

h & (t) = h(t ) + h(t - 1). 

(b) The system in Fig. 6.15(b) is the feedback configuration with transfer 
functions Hi(s) = 1 and H 2 (s) — L {ai)(t - 7 )} = «e , v . Substituting the val- 
ues of Hi(s) and H 2 (s) into Eq. (6.65) yields 

1 


H h (s) = 


1 + ae~ Ts 


310 


Part II Continuous-time signals and systems 


x(t) 




(a) 


(b) 


x(t) 



(c) 

Fig. 6.15. Interconnections 
between LTIC systems. Parts 

(a)-(c) correspond to parts Since H\,(s) is not a rational function of .v, the inverse Laplace transfonn is 

(a)-(c) of Example 6.23. evaluated from the definition in Eq. (6.7), which involves contour integration. 

(c) The transfer function of the parallel configuration shown in the dashed 
box is given by 


#230) = #2 (S) - # 3 0). 


In terms of Ilr^s), the transfer function H\ 2 3 (s) of the top path is given by 


H m (s) = #i0)# 23 0). 


Substituting the value of Hzi(s), the above expression reduces to 
#1230) = #l0)[# 2 0) - #30)]. 

The overall transfer function of the system in Fig. 6.15(c) is given by 
#c0) = #1230) + #40) 


or 


#e0) = #l0)[# 2 0) - #30)] + #40). 
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Taking the inverse Laplace transform of the above equation leads to the follow- 
ing expression for the overall impulse response: 


In this chapter, we introduced the bilateral and unilateral Laplace transforms 
used for the analysis of LTIC signals and systems. The Laplace transforms 
are a generalization of the CTFT, where the independent Laplace variable, 
s = a + j<w, can take any value in the complex s-plane and is not simply 
restricted to the jcu-axis, as is the case for the CTFT. The values of s for 
which the Laplace transforms converge constitute the region of convergence 
(ROC) of the Laplace transforms. In Section 6.2, we derived the unilateral 
Laplace transforms and the associated ROCs for a number of elementary CT 
signals; these transform pairs are listed in Table 6.1. Direct computation of 
the inverse Laplace transform involves contour integration, which is difficult 
to compute analytically. For Laplace transforms, which take a rational form, 
the inverse can be easily determined using the partial fraction approach cov- 
ered in Section 6.3. The properties of the Laplace transform are covered in 
Section 6.4 and listed in Table 6.2. In particular, we covered the linearity, scaling, 
shifting, differentiation, integration, and convolution properties, as summarized 
below. 

(1) The linearity property implies that the Laplace transform of a linear com- 
bination of signals is obtained by taking the same linear combination in the 
complex s-domain. In other words, 

a\X\{t) + ^2*2(0 a\X i(s) + < 12 X 2 (s) with ROC: at least Ri fl R 2 . 

(2) Scaling a signal by a factor of a in the time domain is equivalent to scaling 
its Laplace transform by a factor of 1 /a in the s-domain; i.e. 


(3) Shifting a signal in the time domain is equivalent to multiplication by a 
complex exponential in the s-domain. Mathematically, the time-shifting 
property is expressed as follows: 


(4) The converse of the time-shifting property is also true. In other words, 
shifting a signal in the s-domain is equivalent to multiplication by a complex 
exponential in the time domain: 


h c (t) = /21(f) * h 2 (t ) - /21(f) * /23(f) + /24(f)- 


6.11 Summary 



x(t - to) e~ i,0 X(s) with ROC: R. 


e S0, x(t) X(s - s 0 ) with ROC: R + Re{s 0 }. 
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(5) Differentiation in the time domain is equivalent to multiplication by .s' in the 
complex s-domain. This is referred to as the time-differentiation property 
and is expressed as follows: 

— sX(s) - x(0~) with ROC: R. 
d t 


(6) Integration in the time domain is equivalent to division by s in the complex 
s-domain. This is referred to as the time-integration property and is 
expressed as follows: 


unilateral Laplace transform I x(r)dr 


l 

f 


X(s) 


with ROC: R n Refs} > 0; 


bilateral Laplace transform / x(r)dr 


T 

f 


L X(S) 1 


0 - 

/ 


H — / x(r)dz 
s s 

— oo 

with ROC: R IT Re{s} > 0. 


(7) The convolution property states that convolution in the time domain is 
equivalent to multiplication in the s-domain, and vice versa. Mathemati- 
cally, the convolution property is stated as follows: 

time convolution xi(t)*X 2 (t) 

containing at least ROC: R \ 0 /C; 

s-plane convolution x\{t)x 2 {t) [Xi(s) * X 2 C?)] 

2rrj 

containing at least ROC: R\ 0 /<V 

(8) The initial- and final-value theorems provide us with an alternative approach 
for calculating the limits of a CT function x(t) as t 0 and t -> 00 from 
the following expressions: 

initial-value theorem x(0 + ) = lim x(t) = lirri vA’(.v) 

t— >- 0 + s — > 00 

provided x(0 + ) exists; 

final-value theorem x(oo) = lim x(t) = lim .vX(,s) 

t-*0 O 5^0 

provided x(oo) exists. 

The initial-value theorem is valid for the unilateral Laplace transform, while 
the final-value theorem is valid for both unilateral and bilateral transforms. 


Sections 6.5 to 6.9 discussed various applications of the Laplace transform. The 
time-differentiation property is used in Section 6.5 to solve linear, constant- 
coefficient differential equations. Section 6.6 uses the properties of the ROC 
associated with the Laplace transform with an emphasis on causal systems. 
Sections 6.7 and 6.8 define the stability of the causal LTIC systems in terms 
of the poles and zeros of its transfer function. The key points are summarized 
below. 
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( 1 ) The causal implementation of an absolutely BIBO stable system must have 
all of its poles in the left half of the complex s-plane. 

(2) If even a single pole lies in the right half of the s-plane, the causal imple- 
mentation of the system is unstable. 

(3) If no pole lies in the right half of the s-plane, but one or more first-order 
poles lie on the imaginary jcu-axis, the LTIC system is referred to as a 
marginally stable system. 

(4) An unstable system may be transformed into a stable system by cascading 
the unstable system with an allpass system, which has zeros at the locations 
of the unstable poles. 

Section 6.9 described an analysis technique based on the Laplace transform to 
calculate the output of an LTIC system. We showed that the Laplace-transform- 
based analysis approach is suitable for studying the transient response of the 
systems. The CTFT-based approach is appropriate for analyzing the steady state 
response of the system. 

Finally, Section 6.10 discussed the cascaded, parallel, and feedback config- 
urations used to interconnect two LTIC systems. If two systems with impulse 
responses h\{t) and h 2 (t) are connected, the overall impulse response and the 
corresponding transfer functions are as follows: 

cascaded configuration h(t) = h\(t ) * /?2(0 •<— -* H(s ) = H\ (s)H 2 (s); 

parallel configuration h(t) — h\{t) + h 2 {t) > H(s) = H\(s) + H 2 {s); 

Hi(s) 

feedback configuration H(s)= . 

1 +H t (s)H 2 (s) 

A practical system comprises multiple LTIC systems interconnected with a 
combination of cascaded, parallel, and feedback configurations. 


Problems 


6.1 Using the definition in Eq. (6.5), calculate the bilateral Laplace transform 
and the associated ROC for the following CT functions: 

(a) x(t) = e~ 5 'u(t) + e 4r u(— t); (d) x(t) = e -3 ^ cos(5 1); 

(b) x(t) = e“ 3 ^; (e) x(t) = e 7 ' cos(9 t)u(—t)\ 

l-ui o<m<i 


(c) x(t) = t~ cos(10?)m(— t); 


(f )x(t) 


0 


otherwise. 


6.2 Using Eq. (6.9), calculate the unilateral Laplace transform and the associ- 
ated ROC for the following CT functions: 

(a) x(t) — t 5 u(t); (d) x(t) = e -3 ' cos(9r)«(f); 

(b) x(t) — sin(6t)t/(/‘); (e) x(t) = t 2 cos(10r)t/(f); 

, fl - \t\ 0 < \t\ < 1 

(c) x(t) = cos"(6 t)u(t); (f) x{t) = 


0 


otherwise. 
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6.3 Using the partial fraction expansion approach, calculate the inverse Laplace 
transform for the following rational functions of s : 

(a) X0)= , , 5 ,^ 25 t 1 . .U ROC : Re{s} > -1; 


(b) Xfr) = 

(c) X(s) = 

(d) X(s) = 

(e) X(s) = 

(f) X(s) = 

(g) X(s) = 


(, s + l)(s 2 + 55 + 6) 
s 2 + 2s + 1 
(, s + m 2 + 55 + 6) 
s 2 + 35 — 4 
0 + l)(s 2 + 5s + 6) 
s 2 + 3s — 4 
0 + 1)0 2 + 5s + 6) 

i 2 + 1 

s(s + l)(i 2 + 2s + 17) 
5 + 1 

(s + 2) 2 0 2 + Is + 12) 
i 2 — 2s + 1 


; ROC : Re{^} < -3; 

; ROC : Re{s} > — 1; 

; ROC : Re{^} < -3; 

; ROC : Refs} > 0; 

; ROC : Re{s} > -2; 


; ROC : Re{s} < -1. 


(s + 1) 3 0 2 + 16)’ 

6.4 The Laplace transforms of two CT signals x\ (t) and X 2 (t) are given by the 
following expressions: 

L 5 


and 


Xl (?) 


* 2(0 


s 2 + 55 + 6 


1 

5 2 + 55 + 6 


withROC(Ri) : Re{5} > —2 


with ROC(/? 2 ) : Re{5} > —2. 


Determine the Laplace transform and the associated ROC R of the com- 
bined signal ;ci(0 + 2*2(0- Explain how the ROC R of the combined 
signal exceeds the intersection (R i fl Ri) of the individual ROCs R\ 
and 7?2- 


6.5 Calculate the time-domain representation of the bilateral Laplace transform 


(5 2 - 1)(5 2 - 45 + 5)(5 2 + 45 + 5) 

if the ROC R is specified as follows: 

(a) R : Re{5} < —2; (d) R : 1 < Re{5} < 2; 

(b) R : -2 < Re{5} < -1; (e) R : Re{5} > 2. 

(c) R : — 1 < Re{5} < 1; 

6.6 Prove the frequency-shifting property, Eq. (6.20), as stated in Section 6.4.4. 

6.7 Prove the time-integration property for the unilateral and bilateral Laplace 
transform as stated in Section 6.4.6. 


6.8 Prove the initial-value theorem, Eq. (6.27), as stated in Section 6.4.8. 
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6.9 Prove the final-value theorem, Eq. (6.28), as stated in Section 6.4.8. 

6.10 Using the transform pairs in Table 6.1 and the properties of the Laplace 
transform, prove the following Laplace transform pairs: 

(a) t cos(coot)u(t) ; 

(s z + a z Y 


(b) t sin(&>oO w (0 


2coqS 

(, s 2 + a 2 ) 2 ’ 


(c) 


— T (sin(at) — at cos (at))u(t) 
2 a i 


1 

(s 2 + a 2 ) 2 ' 


6.11 Express the Laplace transform and the associated ROC for the following 
functions in terms of the Laplace transform X(s) with ROC R x of the CT 
function x(t): 

(a) cos(10r)x(r); (d) [.v(r) + 2] 2 ; 

(b) e~ 5, x(4t - 3); 

(c) (f — 4) 4 ^-[x(t — 4)]; 

at 


J e- aso x(a)da. 


6.12 Using the initial- and final-value theorems, calculate the initial and final 
values of the causal CT functions with the following unilateral Laplace 
transforms. In each case, first determine the ROC to see if the initial value 
exists. 


(a) X(s) = 


(b) X(s) = 


(c) X(s) = 


s 2 + Is + 1 ’ 


(d) X(s) = 


s z + 2s + 1 
s 2 + 3s + 4’ 


s 2 + 5s — 4’ (e) x ^ = e 

s 2 + 9 _ 
s 2 -25’ 


—5 s 


s 2 + 4 


s(s + 1 )(s + 2)(s + 3) 


6.13 Solve the following initial-value differential equations using the Laplace 
transform method: 

(a) ^+3^+2y(r) = <5(f); K0“) = J(0“) = 0; 

at 1 at 

(b) $~ + 4 S +4;y(0=M(0; y(0) = y(0) = o; 

(c) + 6^ + 8 y(t) = te~ 3, u(t); y(0~) = y( O') = 1; 

at- dr 

d 3 y d 2 y dv 

w tt + 8 tt + 19 t~ + 12 y ^ = tu{t * 

dr 3 dr 2 dr 

y(0~)= i;K0-) =K0-) = 0; 

(e) d^ + 2 d? + - v(0 = u(t); y(0) = y(0 ) = - V((n = y(0_) = °- 

6.14 Determine (i) the Laplace transfer function, (ii) the impulse response 
function, and (iii) the input-output relationship (in the form of a linear 
constant-coefficient differential equation) for the causal LTIC systems 
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Im{i} 


<>-e- 


-4 


(i) 


-2 

-4 


2 4 


-►Re{i} 


o x x — O-X- 

-4 -2 


(ii) 


Im{i} 


2 4 


-►Re{.s} 


4 
X 2 


_4 _2 

x-2 


-4 


Im{i} 


2 4 
o 


(iii) 


-+-Re{i} 


- y - 2 - 2 

double X 
poles 

(iv) 


Im{i} 


2 4 


-► Re{i} 


Fig. P6.17. Pole - zero plots for 
Problem 6.17. 


with the following input-output pairs: 


(a) x(t) = 4 u(t) 

(b) x(t) = e~ 2, u(t) 

(c) x(t ) = tu(t) 

(d) x(t) = e~ 2 'u(t) 

(e) x(t) = e~ 3, u(t) 


and 

and 

and 

and 

and 


y(t) = tu(t) + e.~ 2, u(t); 
y(t) = 3 e- 2( '- 4) M(t - 4); 
y{t) = [t 2 - 3 e ~ 4 >(0; 
y{t) = e~'u(t) + e^ 3 'rz(t); 
y{t) = e f w(— r) + e~ 3, u(t). 


6.15 Sketch the location of the poles and zeros for the following transfer func- 
tions, and determine if the corresponding causal systems are stable, unsta- 
ble, or marginally stable: 

s 2 


(a) H(s) = 


(b) H(s) = 


(c) H(s) = 


s z + 1 
s 2 + 2s + 1 
2s + 5 
s 2 + s — 6’ 

3s + 10 
5 2 + 9j + 18’ 


(d) H(s) = 


(e) H(s) = 


s 2 + 3s + 2 
s 3 + 3s 2 + 2s 


6.16 Without explicitly calculating the output, determine if the LT1C system 
with the transfer function 

H(s) = 


s 2 + 1 


(j + 5)0 2 + 4)(s 2 + 9 )0 2 + 45 + 5) 

produces a bounded output for the following set of inputs: 

(a) x(t ) = e _ j 2, M(r); 

(b) x{t) = [e~ (1+ J 4) ' + e- (2+j5), ]M(0; 

(c) x{t) = [cos(f) + sin(4f)]w(f); 

(d) x{t) = [cos(2t) + sin(3t)]«(f); 

(e) x(t ) = [e~ (1+ j 2)f sin(3t)]M(t)- 


6.17 The pole-zero plots of four causal LTIC systems are shown in Fig. P6. 17. 
Determine if the LTIC systems are stable. Also determine the transfer 
function // (.v) for each system. Assume that H{ 4) = 1 in all cases, and 
the poles and zeros are all located at integer coordinates in the s-plane. 

6.18 Determine the transfer functions of all possible non-causal implementa- 
tions of the LTIC systems considered in Fig. P6. 17. Specify which transfer 
functions represent stable systems. 
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6.19 The inverse of an LT1C system is defined as the system that when cascaded 
with the original system results in an overall transfer function of unity. 
Without calculating the transfer functions, determine the pole-zero plots 
of the inverse systems associated with the LTIC systems whose pole-zero 
plots are specified in Fig. P6.17. 

6.20 An LTIC system has an impulse response h(t) with the Laplace transfer 
function II (s'), which satisfies the following properties: 

(a) the impulse response h(t) is even and real-valued; 

OO 

(b) the area enclosed by the impulse response is 8, i.e. J h(t)dt — 8; 

— OO 

(c) the Laplace transfer function H(s) has four poles but no zeros; 

(d) the Laplace transfer function H(s ) has a complex pole at s = 
0.5 exp(jjr/4). 

Determine the Laplace transfer function H(s) and the associated ROC. 


6.21 


Consider the RLC series circuit shown in Fig. 3.1. The relationship 

between the input voltage x{t) and the output voltage wit) is given by the 

following differential equation: 

d 2 w R Aw 1 1 

r- ~\~ -f — W(t) = x(t). 

At 2 L At L LC 

By determining the locations of the poles of the transfer function describ- 
ing the RLC series circuit, show that the causal implementation of the RLC 
circuit is always stable for positive values (R > 0, L > 0, and C > 0) of 
the passive components. 


6.22 Given the transfer function 

s 2 — s — 6 

H( ‘ s) ~ (s 2 + 3s + l)(s 2 + 7s + 12) 

(a) determine all possible choices for the ROC; 

(b) determine the impulse response of a causal implementation of the 
transfer function H(s ); 

(c) determine the left-sided impulse response with the specified transfer 
function H(s ); 

(d) determine all possible choices of double-sided impulse responses hav- 
ing the specified transfer function H(s). 

(e) Which of the four impulse responses obtained in (b)-(d) are stable? 


6.23 Repeat Problem 6.22 for the following transfer function: 

s 2 - 5s - 84 

H(s) = — . 

is 2 -2s- 35 )(i 2 + 9s + 20) 

6.24 For most practical applications, we are interested in implementing a causal 
and stable system. The causal implementations of some of the transfer 
functions specified in Problem 6.15 are not stable. For each such trans- 
fer function, specify an allpass system that may be cascaded in a series 
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Fig. P6.25. Interconnected 
systems specified in Problem 
6 . 25 . 



(ii) 


x(t) 



}<t) 


(iii) 


configuration to the specified transfer function to make its causal imple- 
mentation stable. 

6.25 Determine the overall transfer function for the three interconnected sys- 
tems shown in Fig. P6.25. 

6.26 Using the function residue available in Matlab toolboxes, calculate 
the partial fraction coefficients for the transfer functions considered in 
Problem 6.3. 

6.27 Using the functions tf and bode available in the Matlab control 
toolbox, plot the frequency characteristics of the systems with transfer 
functions considered in Problem 6.15. 

6.28 Repeat Problem 6.27 using the function f r eqs available in the Matlab 
signal toolbox. 

6.29 Using the functions tf and impulse available in the Matlab con- 
trol toolbox, calculate the impulse response of the systems with transfer 
functions considered in Problem 6.15. 
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6.30 (a) Using the Matlab function roots, calculate the location of poles 
and zeros of the following transfer functions: 
s 2 - 5s - 84 

( 1 ) tflO) - ^4 _|_ 7i y3 — 33s 2 — 355s — 700 ? 

s 2 - 19s + 84 

(n) H 2 (s) - + 7s 3 _ 33i 2 _ 355 ^_ 700 ’ 


(iii) H 3 (s) 

(iv) // 4 (s) 

(v) H s (s) 


s 3 + 20s 2 + 15s + 61 
s 4 + 5s 3 + 31s 2 + 125s + 150’ 
s 3 - 10s 2 + 25s + 7 

s 6 + 6s 5 + 42s 4 + 48s 3 + 288s 2 + 96s + 544 ’ 
s 2 + 3s + 7 

s 3 + (6 - j7)s 2 + (11- j28)s + (6 - j21) ' 


(b) From the location of poles and zeros in the s-plane, determine if the 
systems are (i) absolutely stable, (ii) marginally stable, or (iii) unstable. 


CHAPTER 



Continuous-time filters 


A common requirement in signal processing is to modify the frequency contents 
of a continuous-time (CT) signal in a predefined manner. In communication sys- 
tems, for example, noise and interference from the neighboring channels cor- 
rupt the information-bearing signal transmitted via a communication channel, 
such as a telephone line. By exploiting the differences between the frequency 
characteristics of the transmitted signal and the channel noise, a linear time- 
invariant system (LTI) system can be designed to compensate for the distortion 
introduced during the transmission. Such an LTI system is referred to as a 
frequency-selective filter, which processes the received signal to eliminate the 
high-frequency components introduced by the channel interference and noise 
from the low-frequency components constituting the information-bearing sig- 
nal. The range of frequencies eliminated from the CT signal applied at the input 
of the filter is referred to as the stop band of the filter, while the range of fre- 
quencies that is left relatively unaffected by the filter constitute the pass band 
of the filter. 

Graphic equalizers used in stereo sound systems provide another application 
for the continuous-time (CT) filters. A graphic equalizer consists of a combina- 
tion of CT filters, each tuned to a different band of frequencies. By selectively 
amplifying or attenuating the frequencies within the operational bands of the 
constituent filters, a graphic equalizer maintains sound consistency within dis- 
similar acoustic environments and spaces. The operation of a graphic equalizer 
is somewhat different from that of a frequency-selective filter used in our earlier 
example of the communication system since it amplifies or attenuates selected 
frequency components of the input signal. A frequency-selective filter, on the 
other hand, attempts to eliminate the frequency components completely within 
the stop band of the filter. 

This chapter focuses on the design of CT filters. We are particularly interested 
in the frequency-selective filters that are categorized in four different categories 
(lowpass, highpass, bandpass, and bandstop) in Section 7.1. Practical approxi- 
mations to the frequency characteristics of the ideal frequency-selective filters 
are presented in Section 7.2, where acceptable levels of distortion is tolerated 
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within the pass and stop bands of the ideal filters. Section 7.3 designs three 
realizable implementations of an ideal lowpass filter. These implementations 
are referred to as the Butterworth, Chebyshev, and elliptic filters. Section 7.4 
transforms the frequency characteristics of the highpass, bandpass, and band- 
stop filters in terms of the characteristics of the lowpass filters. These transfor- 
mations are exploited to design the highpass, bandpass, and bandstop filters. 
Finally, the chapter is concluded with a summary of important concepts in 
Section 7.5. 


7.1 Filter classification 


An ideal frequency-selective filter is a system that passes a prespecified range 
of frequency components without any attenuation but completely rejects the 
remaining frequency components. As discussed earlier, the range of input fre- 
quencies that is left unaffected by the filter is referred to as the pass band of the 
filter, while the range of input frequencies that are blocked from the output is 
referred to as the stop band of the filter. In terms of the magnitude spectrum, the 
absolute value of the transfer function | //(&>) | of the frequency filter, therefore, 
toggles between the values of A and zero as a function of frequency co. The 
gain |//(w)| is A, typically set to one, within the pass band, while H(oo)\ is 
zero within the stop band. Depending upon the range of frequencies within the 
pass and stop bands, an ideal frequency-selective filter is categorized in four 
different categories. These categories are defined in the following discussion. 


7.1.1 Lowpass filters 


The transfer function H\ p (a > ) of an ideal lowpass filter is defined as follows: 


Hi p (co) = 


A 

0 


M < CO c 

M > <w c , 


(7.1) 


where <y c is referred to as the cut-off frequency of the filter. The pass band of 
the lowpass filter is given by \a>\ < co c , while the stop band of the lowpass filter 
is given by <w c < \co\ < oo. The frequency characteristics of an ideal lowpass 
filter are plotted in Fig. 7.1(a), where we observe that the magnitude |//i p (®)| 
toggles between the values of A within the pass band and zero within the stop 
band. The phase <H\ p (a > ) of an ideal lowpass filter is zero for all frequencies. 


7.1.2 Highpass filters 

The transfer function H tlp (o)) of an ideal highpass filter is defined as follows: 


Hh P (a>) = 


0 \co\ < a> c 

A |<w| > co c , 


(7.2) 
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A 


A 







^hp(ffl) 


-io c 0 <o c 


-®c 0 




(a) 


(b) 



(c) 


(d) 


Fig. 7.1. Magnitude spectra of 
ideal frequency-selective filters, 
(a) Lowpass filter; (b) highpass 
filter; (c) bandpass filter; 

(d) bandstop filter. 


where co c is the cut-off frequency of the filter. In other words, the transfer 
function of an ideal highpass filter H\ w (co) is related to the transfer function of 
an ideal lowpass filter H\ p (co) by the following relationship: 


#h P (®) — A — H\ p (a>). 


(7.3) 


The pass band of the lowpass filter is given by co c < \co\ < oo, while the stop 
band of the lowpass filter is given by \w\ < co c . The frequency characteristics 
of an ideal lowpass filter are plotted in Fig. 7.1(b). As was the case for the 
ideal lowpass filter, the phase <//h p (cu) of an ideal highpass filter is zero for all 
frequencies. 


7.1.3 Bandpass filters 


The transfer function H\, v (co) of an ideal bandpass filter is defined as follows: 


77bp(cu) — 


A 

0 


CO cl < M < COc2 

aid < |&>| and a > C 2 < \u>\ < oo, 


(7.4) 


where co c i and a > c 2 are collectively referred to as the cut-off frequencies of the 
ideal bandpass filter. The lower frequency co c 1 is referred to as the lower cut 
off, while the higher frequency co c 2 is referred to as the higher cut off. Unlike 
the highpass filter, the bandpass filter has a finite bandwidth as it only allows a 
range of frequencies (a> c 1 < u> < co c 2 ) to be passed through the filter. 


7.1.4 Bandstop filters 

The transfer function ll\ r Jo>) of an ideal bandstop filter is defined as follows: 


77bp(cu) — 


0 COd < \co\ < CO c 2 
A a>ci < \co\ and co c 2 < M < 00, 


(7.5) 
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where &> c i and a > C 2 are, respectively, referred to as the lower cut-off and higher 
cut-off frequencies of the ideal bandstop filter. A bandstop filter can be imple- 
mented from a bandpass filter using the following relationship: 


HM — A — H bp (a)). (7.6) 

The ideal bandstop filter is the converse of the ideal bandpass filter as it elimi- 
nates a certain range of frequencies (oj c \ < co < co c 2 ) from the input signal. 

In the above discussion, we used the transfer function to categorize different 
types of frequency selective filters. Example 7.1 derives the impulse response 
for ideal lowpass and highpass filters. 

Example 7.1 

Determine the impulse response of an ideal lowpass filter and an ideal highpass 
filter. In each case, assume a gain of A within the pass band and a cut-off 
frequency of co c . 


Fig. 7.2. Impulse responses h(t) 
of: (a) ideal lowpass filter and 
(b) ideal highpass filter derived 
in Example 7.1. 


Solution 

Taking the inverse CTFT of Eq. (7.1), we obtain 

(D c 

h l Jt) = %~ 1 {H((o)} = — [ A ■ e^'dco = 




]2nt 


]2 nt 




-jw c ri 


which reduces to 


, , . 2jA sin (co c t) co c A . / co c t 

«i P (0 = = sine 

)2nt n 


(7.7) 


To derive the impulse response /ih p (0 of the ideal highpass filter, we take the 
inverse CTFT of Eq. (7.3). The resulting relationship is given by 


WrA 


/i h p(f) = AS(t) - /iip(f) = AS(t) sine I . 


7T 


OOrt 


It 


(7.8) 




(a) 


(b) 
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The impulse responses of ideal lowpass and highpass filters are plotted in 
Fig. 7.2. In both cases, we note that the filters have an infinite length in the 
time domain. Also, both filters are non-causal since li(t) ^ 0 for t < 0. 


7.2 Non-ideal filter characteristics 


As is true for any ideal system, the ideal frequency-selective filters are not 
physically realizable for a variety of reasons. From the frequency characteristics 
of the ideal filters, we note that the gain A of the biters is constant within the 
pass band, while the gain within the stop band is strictly zero. A second issue 
with the transfer functions //(&>), specibed for ideal biters in Eqs. (7. 1) — (7.5), 
is the sharp transition between the pass and stop bands such that there is a 
discontinuity in H{a>) at a> = w c . In practice, we cannot implement biters with 
constant gains within the pass and stop bands. Also, abrupt transitions cannot 
be designed. This is observed in Example 7.1, where the constant gains and 
the sharp transition in the ideal lowpass and highpass biters lead to non-causal 
impulse responses which are of inbnite length. Clearly, such LTI systems cannot 
be implemented in the physical world. 

To obtain a physically realizable biter, it is necessary to relax some of the 
requirements of the ideal biters. Figure 7.3 shows the frequency characteristics 
of physically realizable versions of various ideal biters. The upper and lower 
bounds for the gains are indicated by the shaded line, while examples of the 
frequency characteristics of physically realizable biters that satisfy the specibed 
bounds are shown using bold lines. These biters are referred to as non-ideal 
or practical biters and are different from the ideal biters in the following two 
ways. 

(i) The gains of the practical biters within the pass and stop bands are not 
constant but vary within the following limits: 

pass bands 1 — <5 p < \H(co)\ < 1 + <5 p ; (7.9) 

stopbands 0 < \H(co)\ < S s . (7.10) 

The oscillations within the pass and stop bands are referred to as ripples. In 
Fig. 7.3, the pass band ripples are constrained to a value of <5 p for lowpass, 
highpass, and bandpass biters. In the case of the bandstop biter, the pass 
band ripple is limited to <$ p | and S p 2 , corresponding to the two pass bands. 
Similarly, the stop band ripples in Fig. 7.3 are constrained to <5 S for lowpass, 
highpass, and bandstop biters. In the case of the bandstop biter, the stop 
band ripple is limited to <5 sl and S s2 for the two stop bands of the bandstop 
biter. 

(ii) Transition bands of non-zero bandwidth are included in between the pass 
and stop bands of the practical biters. Consequently, the discontinuity at 
the cut-off frequency co c of the ideal biters is eliminated. 
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|#i P (w)| |#h P (®)| 




(a) (b) 

|«bp(®)| |^bs(®) 




(c) 


(d) 


Fig. 7.3. Frequency Example 7.2 considers a practical lowpass filter and derives the values for the 

characteristics of practical filters. p ass |-, alu | and the stop band, and the associated gains of the filter. 

(a) Practical lowpass filter; 

(b) practical highpass filter; 

(c) practical bandpass filter; Example 7.2 

(d) practical bandstop filter. Consider a practical lowpass filter with the following transfer function: 

5.018x 10V+2.682x 10 14 ^ 3 -1.026x 10 4 .5 + 3.196x 10 24 
H ^ S} ~ s 5 +9.863 x 10 4 .s 4 +2.107 x 10 10 i 3 + 1.376x 10 15 i 2 + 1.026 x 10 20 r + 3.196x 10 24 ' 


Assuming that the ripple <i p within the pass band is limited to 1 dB and the 
ripple <5 S within the stop band is limited to 40 dB, determine the pass band, 
transition band and stop band of the lowpass filter. 


Solution 

Recall that the CTFT transfer function H{co) of the lowpass filter can be obtained 
by substituting s = ja> in the Laplace transfer function. The resulting magnitude 
spectrum \H(co)\ of the lowpass filter is plotted in Fig. 7.4, where Fig. 7.4(a) 
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(a) 


(b) 


Fig. 7.4. Magnitude spectrum of 
the practical lowpass filter in 
Example 7.2 using (a) a linear 
scale and (b) a decibel scale 
along the y-axis. 


uses a linear scale for the magnitude. Figure 7.4(b) uses a decibel scale to plot 
the magnitude spectrum. 

Expressed on a linear scale, the pass-band ripple <5 p is given by 10“ 1/20 or 
0.8913. From Fig. 7.4(a), we observe that the pass-band frequency &> p corre- 
sponding to \H(co)\ — 0.8913 is given by 3.47T x 10 4 radians/s. Therefore, the 
pass band is specified by \co\ < 3.47T x 10 4 radians/s. 

To determine the stop band, we use Fig. 7.4(b), which uses a decibel scale 
20 x log 10 |//(&>)| to plot the magnitude spectrum. Figure 7.4(b) shows that 
the smallest frequency for which the magnitude spectrum equals a gain of 
40 dB is given by 4.127T x 10 4 radians/s. The stop band is therefore specified 
by | at | > 4.12;r x 10 4 radians/s. 

Based on the aforementioned results, it is straightforward to derive the tran- 
sition band as follows: 

3.4jt x 10 4 < |ft>| < 4. 12 tt x 10 4 radians/s. 


7.2.1 Cut-off frequency 

An important parameter in the design of CT filters is the cut-off frequency 
a> c of the filter, which is defined as the frequency at which the gain of the 
filter drops to 0.7071 times its maximum value. Assuming a gain of unity 
within the pass band, the gain at the cut-off frequency co c is given by 0.7071 or 
—3 dB on a logarithmic scale. Since the cut-off frequency lies typically within 
the transitional band of the filter, therefore 

®p < COc < CDs (7.11) 

For a lowpass filter. Note that the equality a> p = co c = a> s implies a transitional 
band of zero bandwidth and is valid only for ideal filters. 

As a side note to our discussion, we observe that in this chapter we only 
consider positive values of frequencies co in plotting the magnitude spectrum. 
The majority of our designs are based on real-valued impulse responses, which 
lead to frequency spectra that satisfy the Hermitian symmetry. Exploiting the 
even symmetry for the magnitude spectrum, it is therefore sufficient to spec- 
ify the magnitude spectrum only for positive frequencies in such cases. The 
pass-band, stop-band, and cut-off frequencies are also specified by positive 
values, though their counter-negative values exist for all three parameters. 
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Example 7.3 

Determine the cut-off frequency for the lowpass filter specified in Example 7.2. 

Solution 

Based on the magnitude spectrum, we note that the maximum gain of the filter 
is given by 1 or 0 dB. At the cut off frequency co c , 

\H(co c )\ = 0.7071 x 1 = 0.7071, 

which implies that 

5.018 xl0 3 (j&> c ) 4 +2.682 x 10 14 (jw c ) 2 - 1.026x 10 4 (jco c )+3.196 x 10 24 
(j(u c ) 5 + 9.863x 10 4 (jaj c ) 4 +2.107x 10 10 (ja) c ) 3 + 1.376x 10 15 (jaj c ) 2 + 1.026x 10 20 (jw c )+3.196x 10 24 
= 0.7071. 

The above equality can be solved for co c using numerical techniques in 
Matlab. The value of the cut-off frequency is given by a> c = 3.4627T x 
10 4 radians/s. Note that the cut-off frequency lies within the transitional 
band in between the pass and stop bands of the lowpass filter as derived in 
Example 7.2. 


7.3 Design of CT lowpass filters 


To begin our discussion of the design of CT filters, we consider a prototype or 
normalized lowpass filter, defined as a lowpass filter, with a cut-off frequency 
of (o c = 1 radians/s. The remaining specifications for the pass and stop bands 
of the normalized lowpass filter are assumed to be given by 

pass band (0 < \u>\ < <w p radians/s) 1 — <5 p < \H(a>)\ < 1 + <5 p ; (7.12) 

stop band (| co \ > u> s radians/s) | H(a>)\ < 8 S , (7.13) 

withcup < a> c < o> s . Using the transfer function of the normalized lowpass filter, 
it is straightforward to implement any of the more complicated CT filters. 
Section 7.4 considers the frequency transformations used to convert a lowpass 
filter into another category of frequency-selective filters. 

There are several specialized implementations such as Butterworth, Type I 
Chebyshev, Type II Chebysev, and elliptic biters, which may be used to design 
a normalized lowpass biter. Figure 7.5 shows representative characteristics of 
these implementations, where we observe that the Butterworth biter (Fig. 7.5(a)) 
has a monotonic transfer function such that the gain decreases monotonically 
from its maximum value of unity at u> — 0 along the positive frequency axis. 
The magnitude spectrum of the Butterworth biter has negligible ripples within 
the pass and stop bands, but has a relatively lower fall off leading to a wide 
transitional band. By allowing some ripples in either the pass or stop band, 
the Type I and Type II Chebyshev biters incorporate a sharper fall off. The 
Type I Chebyshev biter constitutes ripples within the pass band, while the 
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Type II Chebyshev filter allows for the stop-band ripples. Compared with the 
Butterworth filter, both Type I and Type II Chebyshev filters have narrower 
transitional bands. The elliptic filters allow for the sharpest fall off by incorpo- 
rating ripples in both the pass and stop bands of the filter. The elliptic filters 
have the narrowest transitional band. To compare the transitional bands. Fig. 7.5 
plots the magnitude spectra resulting from the Butterworth, Type I Chebyshev, 
Type II Chebysev, and elliptic filters with the same order N. 

Figure 7.5 confirms our earlier observations that the Butterworth filter 
(Fig. 7.5(a)) has the widest transitional band. Both the Type I and Type II 
Chebyshev filters (Figs. 7.5(b) and (c)) have roughly equal transitional bands, 
which are narrower than the transitional band of the Butterworth filter. The ellip- 
tic filter (Fig. 7.5(d)) has the narrowest transitional band but includes ripples in 
both the pass and stop bands. 

We now consider the design techniques for the four specialized implemen- 
tations with a brief explanation of the MATLAB library functions useful for 
computing the transfer functions of the implementations. 


7.3.1 Butterworth filters 

The frequency characteristics of an /Vth-order lowpass Butterworth filter are 
given by 


\H{co)\ = 



(7.14) 


where co c is the cut-off frequency of the filter. Substituting a> c = 1 for the 
normalized implementation, the transfer function of the normalized lowpass 
Butterworth filter of order N is given by 


\H(co)\ = 


1 

Vl +C0 2N ' 


(7.15) 


To derive the Laplace transfer function H(s) of the normalized Butterworth 
filter, we use the following relationship: 


\H{co)\ 2 = H(s)H(-s)\ s=jro . (7.16) 


Substituting a> — ,v/j, Eq. (7.16) reduces to 


H(s)H(- S )=\H( S /j)\ 2 . 


(7.17) 
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(a) 


(b) 



(c) 


(d) 


Fig. 7.5. Frequency Further substituting H(s/ j) from Eq. (7.15) leads to the following expression: 

characteristics of standard 

implementations of lowpass H(s)H( s) — ^ (7 18) 

filters of order N . / v x 2N ’ 


(a) Butterworth filter; (b) Type-1 ^ \ j / 

Chebyshev filter; (c) Type-1 1 

Chebyshev filter- (d) elliptic filter where the denominator represents the characteristic function for H(s)H(—s). 
The poles of H(s)H(—s) occur at 


2 N 


— _ 1 _ e i(2«-l)jr 


(7.19) 


or 


5 = j exp 


.(2 n — 1 )jt 


J- 


2 N 


— exp 


.7 r . (2n — l)7r 

J 2 +J ZW 


(7.20) 


for 0 < n < 2N—1. It is clear that the 2N poles for // (s)ll ( — ,v ) , specified in 
Eq. (7.20), are evenly distributed along the unit circle in the complex s-plane. 
Of these, N poles would lie in the left half of the s-plane, while the remaining 
N poles would be in the right half of the s-plane. To ensure a causal and 
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Table 7.1. Location of the IN poles for H(s)H(-s) in Example 7.4 for N = 7 


n 0 1 2 3 4 5 6 7 8 9 10 11 12 13 

n n gj3ir/7 e j4ir/7 gj5jr/7 gj6jr/7 gjir g-j6ir/7 g-j5ir/7 g-j4jr/7 g-j3x/7 g-j2jr/7 g-j*/7 j gji/7 gj2i/7 


stable implementation, the transfer function H(s) of the normalized lowpass 
Butterworth filter is determined from the N poles lying in the left half of the 
s-plane and is given by 

H(js) =ir -^ , (7.21) 

PI (* ~ Pn) 
n = 1 

where p„, for 1 <n<N, denotes the location of the poles in the left-half 
s-plane. 

Example 7.4 

Determine the Laplace transfer function H(s ) for the normalized Butterworth 
filter with cut-off frequency co c = 1 and order N = 1 . 


Solution 

Using Eq. (7.20), the poles of H(s)H{—s) are given by 


s = exp 


7 r (2 n 

j 2 + J — 


— l)n 
14 


for 0 < n < 13. Substituting different values of n. the locations of the poles are 
specified by Table 7.1. Figure 7.6 plots the locations of the poles for H(s)H(—s) 
in the complex s-plane. Allocating the poles located in the left-half s-plane 
(1 <n< 7), the Laplace transfer function // (s) of the Butterworth filter is 
given by 


Im{^} 


« = 1 

n = 0 

n - 2 x X 

x n = 

n = 3 ^ 

1.0 M n 

« = 5’k 

* « 

3 

II 

3 ON 
11 * 

,x « = 

* n = 8 


H(s) = 


1 

(s - ej 4,r / 7 )L -eJ 5,r / 7 )L -e-J fe / 7 )L -e“J 5,r / 7 )L -e-J 4,r / 7 ) ’ 


which simplifies to 


H(s) = 


1 

(s + 1 )[(j — eJ 4)r / 7 )(i — e _ j 4ir / 7 )] [(s — e-i 5,r77 )(s — e~-i 5,r/7 )] [(i — ei 6yr/7 )(s — e - J 6ir / 7 )] 


or 


Fig. 7.6. Location of the poles 
for in the complex 

s-plane for N = 7. The poles 
lying in the left-half s-plane are 
allocated to the Butterworth 
filter. 


1 

H(S) ~ (s+ l)(s 2 + 0.4450 i + l)(i 2 + 1.2470 5 + l)(i 2 + 1.8019^ + 1)' 

In Example 7.4, we observed that the locations of poles for the normalized 
Butterworth filter are complex. Since the poles occur in complex-conjugate 
pairs, the coefficients of the Laplace transfer function for the normalized 
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Table 7.2. Denominator D (s) for transfer function H ( s ) of the Butterworth filter 

N D(s) 

1 Cs + 1) 

2 (i 2 + 1.414.? + 1) 

3 Cs + l)(s 2 + 5 + 1) 

4 (s 2 + 0.7654s + 1)C? 2 + 1.8478s + 1) 

5 (s + 1)(lS 2 + 0.6810s + l)(s 2 + 1.6810s + 1) 

6 (s 2 + 0.5176s + l)(s 2 + 1.4142s + l)(s 2 + 1.9319s + 1) 

7 (s+ l)(s 2 + 0.4450 s + l)(s 2 + 1.2470 s + l)(s 2 + 1.8019s + 1) 

8 (s 2 + 0.3902s + l)(s 2 + 1.1111s + l)(s 2 + 1.6629s + l)(s 2 + 1.9616s + 1) 

9 (s + l)(s 2 + 0.3473 s + l)(s 2 + s+ l)(s 2 + 1.5321 s+ l)(s 2 + 1.8794s + 1) 

10 (s 2 + 0.3129 s + l)(s 2 + 0.9080s + l)(s 2 + 1.4142s + l)(s 2 + 1.7820s + l)(s 2 + 1.9754s + 1) 


Butterworth filter are all real-valued. In general, Eq. (7.21) can be simplified as 
follows: 

1 1 

H(s) = = — — : (7.22) 

D(s ) s n +cin- is n 1 + • • • + cqs + 1 

and represents the transfer function of the normalized Butterworth filter of 
order N. 

Repeating Example 7.4 for different orders (1 < IV < 10), the transfer func- 
tions H(s) of the resulting normalized Butterworth filters can be similarly com- 
puted. Since the numerator of the transfer function is always unity, Table 7.2 
lists the polynomials for the denominator D(s) for 1 < /V < 1 0. 

7.3.1. 1 Design steps for the lowpass Butterworth filter 

In this section, we will design a Butterworth lowpass filter based on the spec- 
ifications illustrated in Fig. 7.3(a). Mathematically, the specifications can be 
expressed as follows: 

pass band (0 < |<y| < co p radians/s) 1 — <5 p < \H(co)\ < 1 + <5 p ; (7.23) 

stopband (|a>| > qj s radians/s) \H(co)\ < <5 S . (7.24) 

At times, Eq. (7.23) is also expressed in terms of the pass-band ripple as 
20 logio<5 p dB. Similarly, Eq. (7.24) is expressed in terms of the stop-band 
ripple as 20 logio<5 s dB. The design of the Butterworth filter consists of the 
following steps, which we refer to as Algorithm 7. 3. 1.1. 

Step 1 Determine the order N of the Butterworth filter. To determine the order 
N of the filter, we calculate the gain of the filter at the corner frequencies co = co v 
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and a) — co s . Using Eq. (7.15), the two gains are given by 


pass-band comer frequency (a> = w v ) 


stop-band corner frequency ( w = co s ) 


\H{cd v )\ 2 = 
\H(a> s )\ 2 = 


1 _ ^2 

if(V# =(Mp) ’ 

(7.25) 

1 _ 2 

1 + (co s /a> c ) 2N ^ ' 

(7.26) 


Equations (7.25) and (7.26) can alternatively be expressed as follows: 

(co p /co c ) 2N = n \ , 2 - 1 (7-27) 

(1 Op) 

and 


{m s /m c ) 2n 


1 

(5J 2 


(7.28) 


Dividing Eq. (7.27) by Eq. (7.28) and simplifying in terms of N , we obtain the 
following expression: 


1 ln(G p /G s ) 

N = - x 

2 ln(£Up/<w s ) 


(7.29) 


where the gain terms are given by 


G P = 


(1 


<$ P ) 2 


— 1 and G s = 


(5 S ) 2 


- 1. 


(7.30) 


Step 2 Using Table 7.2 or otherwise determine the transfer function for the nor- 
malized Butterworth filter of order N. The transfer function for the normalized 
Butterworth filter is denoted by H(S) with the Laplace variable S capitalized 
to indicate the normalized domain. 


Step 3 Determine the cut-off frequency co c of the Butterworth filter using either 
of the following two relationships: 


pass-band constraint 
stop-band constraint 


COr, 


(Gp) 1 / 2 ^ ’ 
COs 

( Gs ) 1 / 2 *- 


(7.31) 

(7.32) 


If Eq. (7.3 1 ) is used to compute the cut-off frequency, then the Butterworth filter 
will satisfy the pass-band constraint exactly. Similarly, the stop-band constraint 
will be satisfied exactly if Eq. (7.32) is used to determine the cut-off frequency. 


Step 4 Determine the transfer function H(s ) of the required lowpass filter 
from the transfer function for the normalized Butterworth filter H(S), obtained 
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in Step 2, and the cut-off frequency &> c , using the following transformation: 

H(s) = H(S)\ S = s /a, c - 

Note that the transformation S = s/a> c represents scaling in the Laplace domain. 
It is therefore clear that the normalized cut-off frequency of 1 radian/s used in 
the normalized Butterworth filter is transformed to a value of <w c as required in 
Step 3. 

Step 5 Sketch the magnitude spectrum from the transfer function H(s ) deter- 
mined in Step 4. Confirm that the transfer function satisfies the initial design 
specifications. 

Examples 7.5 and 7.6 illustrate the application of the design algorithm. 

Example 7.5 

Design a Butterworth lowpass filter with the following specifications: 

pass band (0 < \a>\ < 5 radians/s) 0.8 < \H(a>)\ < 1; 
stop band (| a) | > 20 radians/s) \H(a>)\ < 0.20. 


Solution 

Using Step 1 of Algorithm 7.3. 1.1, the gain terms G p and G s are given by 

1 1 


Gp - (1 - S p )2 


1 = 


0 . 8 2 


1 = 0.5625 


and 


1 1 

G s = - 1 = — - - 1 = 24. 

(5s) 2 0.2 2 

Using Eq. (7.29), the order of the Butterworth filter is given by 

1 ln(G p /G s ) 1 ln(0. 5625/24) 

N = - x = - x = 1.3538. 

2 ln(w p M) 2 ln(5/20) 

We round off the order of the filter to the higher integer value as N — 2. 

Using Step 2 of Algorithm 7.3. 1 . 1 , the transfer function H(S) of the normal- 
ized Butterworth filter with a cut-off frequency of 1 radian/s is given by 

H(S) = 


S 2 + 1.4145+ 1' 

Using the pass-band constraint, Eq. (7.31), in Step 3 of Algorithm 7.3. 1.1, the 
cut-off frequency of the required Butterworth filter is given by 

<Wd 5 


COr 


(Gp) 1 / 2 *' (0.5625) 1 / 4 


= 5.7735 radians/s. 
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(a) 


(b) 


Fig. 7.7. Magnitude spectra of 
the Butterworth lowpass filters, 
designed in Example 7.5, as a 
function of u>. Part (a) satisfies 
the constraint at the pass-band 
corner frequency, while part (b) 
satisfies the magnitude 
constraint at the stop-band 
corner frequency. 


Using Step 4 of Algorithm 7.3. 1.1, the transfer function H(s) of the required 
Butterworth filter is obtained by the following transformation: 


His) = H(S)\ s=s/oic 


1 

£2+ 1.414S+ 1 


S=j/5.7735 


which simplifies to 


H(s) = 


1 

(s/5.7735) 2 + 1.414s/5.7735 + 1 


33.3333 

s 2 + 8. 1637.? + 33.3333' 


Step 5 plots the magnitude spectrum of the Butterworth filter. The CTFT transfer 
function of the Butterworth filter is given by 

33.3333 

H(to) = H(s) s =]a> = 3 ■ 

J (jtt>) 2 + 8.1637(ja>) + 33.3333 

The magnitude spectrum \H{a>)\ is plotted in Fig. 7.7(a) with the specifications 
shown by the shaded lines. We observe that the design specifications are indeed 
satisfied by the magnitude spectrum. 


Alternative implementation An alternative implementation of the aforemen- 
tioned Butterworth filter can be obtained by using the stop-band constraint, 
Eq. (7.32), in Step 3 of Algorithm 7.3. 1.1. The cut-off frequency of the alter- 
native implementation of the Butterworth filter is given by 

u> s 20 

Wc = (G^r-N = = 9 0360 radians/s - 


Using Step 4 of Algorithm 7.3. 1.1, the transfer function H(s) of the alternative 
implementation is obtained by the following transformation: 


His) = H(S)\ s= s/ ac 


1 

S 2 + 1.4145 + 1 


S=j/9.0360 


which simplifies to 

1 _ 81.6497 

( ' ?) “ (i/9.0360) 2 + 1.4145/9.0360+ 1 ~ .s 2 + 12.7769s + 81.6497' 

Step 5 plots the magnitude spectrum of the alternative implementation of the 
Butterworth filter in Fig. 7.7(b), which satisfies the initial design specifications. 
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Example 7.6 

Design a lowpass Butterworth filter with the following specifications: 

pass band (0 < \a>\ < 50 radians/s) — 1 dB < 201og 10 |//(&>)| < 0; 
stop band (|a>| > 100 radians/s) 201og 10 |//(®)| < — 15dB. 


Solution 

Expressed on a linear scale, the pass-band gain is given by ( 1 — <5 p ) = 10 1/20 = 
0.8913. Similarly, the stop-band gain is given by 8 S — 10 _I5/20 = 0.1778. 
Using Step 1 of Algorithm 7. 3. 1.1, the gain terms G p and G s are given by 


G„ = 


(1 


<$ P ) 2 


1 = 


1 

0.8913 2 


1 = 0.2588 


and 


G s = 


(8s) 2 


1 = 


1 

0.1778 2 


1 = 30.6327. 


The order N of the Butterworth filter is obtained using Eq. (7.29) as follows: 
at 1 ln(G p /G s ) 1 ln(0. 2588/30. 6327) _ 

2 ln(« p /w s ) 2 ln(50/100) 


We round off the order of the filter to the higher integer value as N = 4. 

Using Step 2 of Algorithm 7. 3. 1.1, the transfer function H(S) of the normal- 
ized Butterworth filter with a cut-off frequency of 1 radian/s is given by 


H(S) = 


1 

(S 2 + 0.7654 S + 1)(S 2 + 1.84785' + 1) ' 


Using the pass-band constraint, Eq. (7.31), in Step 3 of Algorithm 7. 3. 1.1, the 
cut-off frequency of the required Butterworth filter is given by 


CO c 


(Gp ) 1 / 2N 


50 

(0.2588) 1 / 8 


= 59.2038 radians/s. 


Using Step 4 of Algorithm 7.3. 1.1, the transfer function II (s) of the required 
Butterworth filter is obtained by the following transformation: 


1 

H(s) = H(S)\ S -s/m = ^ 

1 7 c (S 2 + 0.7654S + 1)(S 2 + 1 .84785" + 1) 


S=j/59.2038 


which simplifies to 


H(s) = 


(3.5051 x 10 3 ) 2 

(s 2 + 45.3146^ + 3.5051 x 10 3 )(s 2 + 109.396.? + 3.5051 x 10 3 ) 


or 


H(s) = 


1.2286 x 10 7 

+ 154.7106 s 3 + 1.1976 x 10V + 5.4228 x 10 5 s + 1.2286 x 10 7 ' 
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Fig. 7.8. Magnitude spectra of 
the Butterworth lowpass filters, 
designed in Example 7.6, as a 
function of a>. Part (a) satisfies 
the constraint at the pass-band 
corner frequency, while part (b) 
satisfies the magnitude 
constraint at the stop-band 
corner frequency. 


Step 5 plots the magnitude spectrum of the Butterworth filter. The CTFT transfer 
function of the Butterworth filter is given by 

H(o) = H(s)\ s=la , 

1.2286x 10 7 

” (jco) 4 + 154.7 106 (jw) 3 + 1.1976 x 10 4 (jco) 2 + 5.4228 x 10 5 (jo>)+ 1.2286 x 10 7 

The magnitude spectrum \H(co)\ is plotted in Fig. 7.8(a), where the labels on the 
y-axis are chosen to correspond to the specified gains for the filter. We observe 
that the design specifications are satisfied by the magnitude spectrum. 


Alternative implementation An alternative implementation of the aforemen- 
tioned Butterworth filter can be obtained by using the stop-band constraint, 
Eq. (7.32), in Step 3 of Algorithm 7. 3. 1.1. The cut-off frequency of the alter- 
native implementation of the Butterworth filter is given by 
w s 100 

co c = — — = — = 65.1969 radians/s. 

(G s ) l ' 2N (30.6327) 1 / 4 


Using Step 4 of Algorithm 7. 3. 1.1, the transfer function H(s ) of the alternative 
implementation is obtained by the following transformation: 


H(s) = H{S) \ s=s/ac 


1 

( S 2 + 0.7654S + 1)(S 2 + 1.84785' + 1) 


S=*/65.1969 


which simplifies to 


H(s) = 


(4.2506 x 10 3 ) 2 

(s 2 + 49.9017s + 4.2506 x 10 3 )(s 2 + 120.4708s + 4.2506 x 10 3 ) 


or 


H(s) = 


1.8068 x 10 7 

s 4 + 170.3725 s 3 + 1.4513 x 10 4 s 2 + 7.2419 x 10 5 i + 1.8068 x 10 7 ' 


Step 5 plots the magnitude spectrum of the alternative implementation of the 
Butterworth filter in Fig. 7.8(b), which satisfies the initial design specifications. 


7.3. 1.2 Butterworth filter design using Matlab 

Matlab incorporates a number of functions to implement the design algo- 
rithm for the Butterworth filter specified in Section 7.3. 1 . 1 . The order N and the 
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cut-off wc frequency for the filter in Step 1 of Algorithm 7. 3. 1.1 can be deter- 
mined using the library function buttord, which has the following calling 
syntax: 

»[N,wc] = buttord(wp,ws,Rp,Rs, 's' ) ; 

where wp is the corner frequency of the pass band, ws is the corner frequency 
of the stop band, Rp is the permissible ripple in the pass band in decibels, 
and Rs is the permissible attenuation in the stop band in decibels. The last 
argument ' s ' specifies that a CT filter in the Laplace domain is to be designed. 
In determining the cut-off frequency, Matlab uses the stop-band constraint, 
Eq. (7.32). 

Having determined the order and the cut-off frequency, the coefficients 
of the numerator and denominator polynomials of the Butterworth filter can 
be determined using the library function butter with the following calling 
syntax: 

»[num,den] = butter (N,wc, ' s ') ; 

where num is a vector containing the coefficients of the numerator and den is 
a vector containing the coefficients of the denominator in decreasing powers 
of.?. 

Finally, the transfer function H(s ) can be determined using the library func- 
tion tf as follows: 

» H = t f ( num , den ) . 

For Example 7.5, the Matlab commands for designing the Butterworth filter 
are given by 

» wp=5; ws=20; Rp=1.9382; Rs=13.9794; 

% specify design parameters 
% Rp = -20*logl0 (0.8) 

% = 1 . 9382dB 
% Rs = -20*logl0 (0.2) 

% = 13 . 9794dB 

» [N, wc] =buttord (wp , ws , Rp, Rs , ' s ' ) ; 

% determine order and 
% cut-off freg 

» [num, den] =butter (N,wc,'s'); 

% determine num and denom 
% coeff. 

» Ht = tf (num, den); % determine transfer 

% function 

» [H , w] = f reqs (num, den) ; % determine magnitude 

% spectrum 

% plot magnitude spectrum 


» plot (w, abs (H) ) ; 
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Stepwise implementation of the above code returns the following values for 
different variables: 

Instruction II: N = 2 ; wc = 9.0360; 

Instruction III: num =[00 81.6497]; den = [1.0000 
12.7789 81.6497] ; 

Instruction IV: Ht = l/(s~2 + 12.78s + 81.65); 

The magnitude spectrum is the same as that given in Fig. 7.7(b). 


7.3.2 Type I Chebyshev filters 

Butterworth filters have a relatively low roll off in the transitional band, which 
leads to a large transitional bandwidth. Type I Chebyshev filters reduce the 
bandwidth of the transitional band by using an approximating function, referred 
to as the Type I Chebyshev polynomial, with a magnitude response that has 
ripples within the pass band. We start with the definition of the Chebyshev 
polynomial. 


7.3 .2.1 Type I Chebyshev polynomial 

The /Vth-order Type I Chebyshev polynomial is defined as 


cos(7Vcos '(«)) M < 1 
cosh(7V cosh' '(&>)) \w\ > 1, 


(7.33) 


where cosh(x) denotes the hyperbolic cosine function, which is given by 

Q X -J- * 

cosh(x) = cos(jx) = . (7.34) 

Starting from the initial values of Tq(w) = 1 and 7) (o>) = co, the higher orders 
of the Type I Chebyshev polynomial can be recursively generated using the 
following expression: 


7„(<w) = 2&>7’„_i(tt>) - r„_ 2 (ct)). (7.35) 

Table 7.3 lists the Chebyshev polynomial for different values of n within the 
range 0 < n < 10. 

Using Eq. (7.33), the roots of the Type 1 Chebyshev polynomial 7V(cu) can 
be derived as follows: 


co n = cos 


(2 n + 1)7 r 
2N 


(7.36) 


for 0 < n < N — 1. 
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Table 7.3. Chebyshev polynomial T N (cS) for different 
values of N 


N 

T n (id) 

0 

1 

1 

CO 

2 

2ai 2 — 1 

3 

4 g) 3 — 3a) 

4 

8oj 4 - 8ar + 1 

5 

16a> 5 — 20ca 3 + 5 a> 

6 

32o 6 - 48a/ + 18a; 2 - 1 

7 

64a ) 7 — 112a; 5 + 56a; 3 — 7a; 

8 

128a; 8 - 256a; 6 + 160a; 4 - 32a; 2 + 1 

9 

256a; 9 - 576a; 7 + 432a; 5 - 120a; 3 + 9a; 

10 

512a; 10 - 1280a; 8 + 1120a; 6 - 400a; 4 + 50a; 2 - 1 


73.2.2 Type I Chebyshev filter 

The frequency characteristics of the Type I Chebyshev filter of order N are 
defined as follows: 


\H{co)\ = 1 (7.37) 

^1 + e 2 T^(co/co p ) 

where o) p is the pass-band corner frequency and e is the ripple control parameter 
that adjusts the magnitude of the ripple within the pass band. Substituting 
co p = 1 , the frequency characteristics of the normalized Type I Chebyshev filter 
of order N are expressed in terms of the Chebyshev polynomial as follows: 

\H(co)\ = 1 (7.38) 

VI +e 2 T*(co) 

Based on Eqs. (7.35) and (7.38), we make the following observations for the 
frequency characteristics of the normalized Type I Chebyshev filter. 


(1) For a> = 0, the Chebyshev polynomial T n (oj) has a value of ±1 or 0. This 
can be shown by substituting co = 0 in Eq. (7.33), which yields 


/ N(2n + l)7r 

V 2“ 


±1 IV is even 
0 N is odd. 

(7.39) 


T n (0) — cos (N cos '(0)) = cos 
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Equation (7.37) implies that the dc component |//(0)| of the Type I 
Chebyshev filter is given by 


1 ^ ( 0 )| = 


1 

N is even 
1 N is odd. 


(7.40) 


(2) For a>= 1 radian/s, the value of the Chebyshev polynomial T N (a > ) is given 
by 


7)v(l) = cos(ff cos '(!)) = cos(2hNtt) = 1. (7.41) 


Therefore, the magnitude | H(co)\ of the normalized Type I Chebyshev filter 
at co = 1 radian/s is given by 


|ff(DI = 


1 

Vl + e 2 


(7.42) 


irrespective of the order N of the normalized Chebyshev filter. 

(3) For large values of o> within the stop band, the magnitude response of the 
normalized Type I Chebyshev filter can be approximated by 


|ff(«)l 


1 

sT n (oj)’ 


(7.43) 


since eTn(o>) 1. If N 1, then a second approximation can be made 
by ignoring the lower degree terms in T^{co) and using the approximation 
T n {w) ee 2 N ~ l w N . Equation (7.43) is therefore simplified as follows: 

'ff Ml ^ X 2 ^' (7 ' 44) 

(4) Since 


ff(s)ff(-s ) \ s=io = |ff(«)| 2 , 


H(s)H(—s) can be derived from Eq. (7.38) as follows: 


ff(s)ff(-s) 


1 

l+e 2 T>/j)' 


(7.45) 


The 2 N poles of H(s)H(—s) are obtained by solving the characteristic 
equation, 


l+e 2 r 2 ( s /j) = 0, (7.46) 

and are given by 

(2 n - 1 \ /I 

s„ = sin it I sinh — sinh 

V 2N ) \N 

+ jc ° s (^ ,r ) cosh (^ !inirl (0) <747) 

for 1 < n < 2N— 1 . To derive a stable implementation of the normalized 
Type I Chebyshev filter, the N poles in the left-hand s-plane are included 
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in the Laplace transfer function of II (s). From Eq. (7.45), it is clear that 
there are no zeros for the normalized Type I Chebyshev filter. 

Properties (1) — (4) are used to derive the design algorithm for the Type I Cheby- 
shev filter, which is explained in the following. 


73.2.3 Design steps for the lowpass filter 

In this section, we will design a lowpass Type I Chebyshev filter based on the 
following specifications: 

pass band (0 < |o>| < a> p radians/s) 1 — <5 p < \H(co)\ < 1 + <5 p ; 
stop band (|a>| > &> s radians/s) \H(w)\ < S s . 

Since the Type I Chebyshev filter is designed in terms of its normalized version, 
Eq. (7.37), we normalize the aforementioned specifications by the pass-band 
corner frequency a> p . The normalized specifications are as follows: 

pass band (0 < \a>\ < 1) 1 — S p < \H(a>)\ < 1 + <5 p ; 

stop band (|o>| > co s /co p ) |//(&))| < <5 S . 

Step 1 Determine the value of the ripple control factor s. Equation (7.42) 
computes the value of the ripple control factor e : 

, — 1 

s = JgZ with G D = r- — 1. (7.48) 

V P P (l_ gp )2 


Step 2 Calculate the order N of the Chebyshev polynomial. The gain at the 
normalized stop-band corner frequency o> s /o> p is obtained from Eq. (7.37) as 


\H(oj s /oj p )\ 2 


1 

1 + s 2 T^(co s /co p ) 


( 8 S ) 2 . 


(7.49) 


Substituting the value of the Chebyshev polynomial T N {o>) from Eq. (7.33) and 
simplifying the resulting equation, we obtain 


cosh^flGs/Gp) 0 - 5 ] 

cosh _1 [a) s /fe)p] 


(7.50) 


where the gain terms G p and G s are given by 


G P 


1 

(1 - V 2 


with 



(7.51) 


Step 3 Determine the location of the 2N poles of H(S)H(—S) using Eq. (7.47). 
To derive a stable implementation for the normalized Type I Chebyshev filter 
H(S), the N poles lying in the left-half s-plane are selected to derive the transfer 
function H(S). If required, a constant gain term K is also multiplied with ll(S) 
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such that the gain |//(0)| of the normalized Type I Chebyshev filter is unity at 

co — 0 . 

Step 4 Derive the transfer function // (,v) of the required lowpass filter from 
the transfer function H(S) of the normalized Type I Chebyshev filter, obtained 
in Step 3, using the following transformation: 

H{s) = H(S) \ s =s/a> r - (7.52) 

Step 5 Sketch the magnitude spectrum from the transfer function H (s ) deter- 
mined in Step 4. Confirm that the transfer function satisfies the initial design 
specifications. 

Example 7.7 

Repeat Example 7.6 using the Type I Chebyshev filter. 


Solution 

For the given specifications, Example 7.6 calculates the pass-band and stop- 
band gain on a linear scale as (1 — c5 p ) = 0.8913 and S s = 10 -15,/20 = 0.1778 
with the gain terms given by G p = 0.2588 and G s = 30.6327. 

Step 1 determines the value of the ripple control factor e: 

s = y G~ p = V0. 2588 = 0.5087. 

Step 2 determines the order N of the Chebyshev polynomial: 

cosh -1 [(30. 6327/0. 2588) * * * 05 ] 

N = t — = 2.3371. 

cosh -1 [100/50] 

We round off N to the closest higher integer, /V = 3. 

Step 3 determines the location of the six poles of H(S)H{—S): 

[-0.2471 +j0.9660, -0.2471 - j0.9660, 0.2471 +j0.9660, 

0.2471 -j0.9660, 0.4943, -0.4943], 

The three poles lying in the left-half s-plane are included in the transfer 
function H(S ) of the normalized Type I Chebyshev filter. These poles are 
located at 


[-0.2471 +j0.9660, -0.2471 - j0.9660, -0.4943], 


The transfer function for the normalized Type I Chebyshev filter is therefore 
given by 


H(S) = 


K 

(, S + 0.2472 +j0.9660)(S + 0.2472 - j0.9660)(S + 0.4943)’ 


which simplifies to 


K 


H(S) = 


S 3 + 0.9885S 2 + 1.23865 + 0.4914' 
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Fig. 7.9. Magnitude spectrum of i 

the Type I Chebyshev lowpass 0.89 1 3 
filter designed in Example 7.7. g 6 
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Since |H(a>)| at u> — 0 is Af/0.4914, K is set to 0.4914 to make the dc gain equal 
to unity. The new transfer function with unity gain at w = 0 is given by 


H(S) = 


0.4914 

S 3 + 0.9885S 2 + 1.23865 + 0.4914' 


Step 4 transforms the normalized Type I Chebyshev filter using the following 
relationship: 


H(s) = H(S) | s=l/50 = 


0.4914 

(s/50) 3 + 0.9885(s/50) 2 + 1.2386(^/50) + 0.4914 


or 


H(s) = 


6.1425 x 10 4 

s 3 + 49.425s 2 + 3.0965 x 10 3 s + 6.1425 x 10 4 ’ 


which is the transfer function of the required lowpass filter. 

The magnitude spectrum of the Type I Chebyshev filter is plotted in Fig. 7.9. 
It is observed that Fig. 7.9 satisfies the initial design specifications. 


Examples 7.6 and 7.7 used the Butterworth and Type I Chebyshev implemen- 
tations to design a lowpass filter based on the same specifications. Comparing 
the magnitude spectra (Figs. 7.8 and 7.9) for the resulting filters, we note that 
the Butterworth filter has a monotonic gain with negligible ripples in the pass 
and stop bands. By introducing pass-band ripples, the Type I Chebyshev imple- 
mentation is able to satisfy the design specifications with a lower order N for 
the lowpass filter, thus reducing the complexity of the filter. However, savings 
in the complexity are achieved at the expense of ripples, which are added to the 
the pass band of the frequency characteristics of the Type I Chebyshev filter. 


73.2.4 Type I Chebyshev filter design using Matlab 

Matlab uses the cheblord and chebyl functions to implement the 
Type I Chebyshev filter. The cheblord function determines the order N of 
the Type I Chebyshev filter from the pass-band corner frequency wp, stop-band 
corner frequency ws, pass-band attenuation rp, and the stop-band attenuation 
rs. In terms of the filter specifications, Eqs. (7.23) and (7.24), the values of the 
pass-band attenuation rp and the stop-band attenuation rs are given by 


rp = 20 x log 10 (<5 p ) and rs = 20 x log 10 (<5 s ). 
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The cheblord also returns wn, another design parameter referred to as the 
Chebyshev natural frequency to use with chebyl to achieve the design spec- 
ifications. The syntax for cheblord is given by 

>> [N,wn] = cheblord (wp,ws , rp, rs ,' s ') ; 

To determine the coefficients of the numerator and denominator of the 
Type I Chebyshev filter, Matlab uses the chebl function with the following 
syntax: 

>> [num.den] = chebyl (N, rp,wn, ' s ') ; 

The transfer function // (,v) can be determined using the library function tf as 
follows: 

>> H = tf (num, den); 

For Example 7.7, the Matlab commands for designing the Butterworth filter 
are given by 

>> wp=50; ws=100; rp=l; rs=15; 

% specify design parameters 
>> [N,wn] = cheblord (wp, ws , rp, rs , ' s ' ) ; 

% determine order and 
% natural freq 

>> [num.den] = chebyl (N, rp , wn, ' s ' ) ; 

% determine num and denom 
% coeff. 

>> Ht = tf (num, den) ; % determine transfer 

% function 

>> [ H , w] = f reqs (num, den) ; % determine magnitude 

% spectrum 

>> plot (w, abs (H) ) ; % plot magnitude spectrum 

Stepwise implementation of the above code returns the following values for 
different variables: 

Instruction II: N = 3; wn = 50; 

Instruction III: num =[000 61413.3]; den = 

[1.0000 49.417 3096 61413.3]; 

Instruction IV: Ht = 61413.3/ (s~3 + 49.417s''2 + 3096s 
+ 61413.3) ; 

The magnitude spectrum is the same as that given in Fig. 7.9. 


7.3.3 Type II Chebyshev filters 

The Type II Chebyshev filters, or the inverse Chebyshev filters, are monotonic 
within the pass band and introduce ripples in the stop band. Such an imple- 
mentation is preferred over the Type I Chebyshev filter in applications where a 
constant gain is desired within the pass band. 


345 


7 Continuous-time filters 


The frequency characteristics of the Type II Chebyshev filter are given by 


\H(a>)\ = 


v/l + [e 2 T*(.a)Ja>)\ 


e 2 T 2 {w s /(o) 

■ s 2 T^(co s /co) ’ 


(7.53) 


where oj s is the lower comer frequency of the stop band. To derive the normalized 
version of the Type II Chebyshev filter, we set a) s — 1 in Eq. (7.53) leading to 
the following expression for the frequency characteristics of the normalized 
Type II Chebyshev filter: 


\H(a>)\ = 



e 2 T 2 {\/co) 

l+s 2 T 2 a/co)' 


(7.54) 


In the following section, we list the steps involved in the design of the Type II 
Chebyshev filter. 


7.3.3.1 Design steps for the lowpass filter 

The design of the lowpass Type II Chebyshev filter is based on the following 
specifications: 

pass band (0 < |<u| < co p radians/s) 1 — <5 p < |//(a>)| < 1 + <5 P ; 
stop band (|a>| > ft> s radians/s) |i/(a>)| < S s . 

Normalizing the specifications with the stop-band corner frequency co s , we 
obtain 

pass band (0 < |<w| < cu p /<u s ) 1 — <5 p < |//(<u)| < 1 + <5 p ; 

stop band (|&)| > 1) \H{co)\ < 8 S . 

Step 1 Compute the value of the ripple factor by setting the normalized fre- 
quency cu = 1 in Eq. (7.54). Since the Type II Chebyshev filter is normalized 
with respect to a > s , the normalized frequency a> = 1 corresponds to co s and the 
filter gain 1) = <5 S . Substituting //( I ) = <5 S in Eq. (7.54), we obtain 



which simplifies to 


1 

VGs 


(7.55) 


with the gain term specified in Eq. (7.51). 
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Step 2 Compute the order N of the Type II Chebyshev filter. To derive an 
expression for the order N, we compute the gain | // (a>)\ at the normalized pass- 
band corner frequency co p /a> & . Substituting \H{co)\ = (1 — <5 p ) at co = co p /a . > s , 
we obtain 


Substituting the value of the Chebyshev polynomial from Eq. (7.33) and sim- 
plifying the resulting expression with respect to N yields 


where the gain terms G p and G s are defined in Eq. (7.51). Note that the expres- 
sion for the order of the filter for the Type II Chebyshev filter is the same as the 
corresponding expression, Eq. (7.50), for the Type I Chebyshev filter. 

Step 3 Determine the location of the poles and zeros of the transfer function 
H(S) of the normalized Type II Chebyshev filter. Substituting 


the Laplace transfer function for the normalized Type II Chebyshev filter is 
given by 


The poles of H(s)H(—s) are obtained by solving for the roots of the character- 
istic equation. 


Comparing with the characteristic equation for H(s)H(—s) of the Type I Cheby- 
shev filter, Eq. (7.46), we note that (s/j) in the Chebyshev polynomial of 
Eq. (7.46) is replaced by (j/s) in Eq. (7.58). This implies that the poles of 
the normalized Type II Chebyshev filter are simply the inverse of the poles of 
the Type I Chebyshev filter. Hence, the location of the poles for the normalized 
Type II Chebyshev filter can be computed by determining the locations of the 
poles for the normalized Type I Chebyshev filter and then taking the inverse. 

The zeros of H(s)H(—s) are obtaining by solving 


The zeros of H(s)H{—s) are therefore the inverse of the roots of the Chebyshev 
polynomial 7)v(tt>) = 7’.v(.s7j), which are given by 


s 2 T 2 (co s /co p ) 



1 + s 2 T 2 (co s /co p ) 



(7.56) 


H(s)H(-s) \ s=ia = \H(co)\ 2 , 


H(s)H(-s) = 



(7.57) 


1 + e 2 T 2 (i/s) 


\+s 2 T 2 ()/s) = 0. 


(7.58) 


T 2 n { j/s) = 0 . 


(7.59) 


CO = cos 


(2 n + 1)7T 
2N 
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The zeros of H(s) are therefore given by 


s 


cos 


( 2 n + Itt ^ 

V 2 N ) 


(7.60) 


for0< n < N— 1. The poles and zeros are used to evaluate the transfer function 
H(S) for the normalized Type II Chebyshev filter. If required, a constant gain 
term K is also multiplied by H(S) such that the gain 1 77(0)1 of the normalized 
Type II Chebyshev filter is unity at <x> = 0. 


Step 4 Derive the transfer function H(s) of the required lowpass filter from the 
transfer function H(S) of the normalized Type II Chebyshev filter, obtained in 
Step 3, using the following transformation: 

H(s) = H(S) \ s=s/a>s . (7.61) 

Step 5 Sketch the magnitude spectrum from the transfer function H(s ) deter- 
mined in Step 4. Confirm that the transfer function satisfies the initial design 
specifications. 

Example 7.8 

Repeat Example 7.6 using the Type II Chebyshev filter. 

Solution 

As calculated in Example 7.6, the pass-band and stop-band gain are ( 1 — c5 p ) = 
0.8913 and 8 S = 10" 15 / 20 = 0.1778. The gain terms are also calculated as 
G p = 0.2588 and G s = 30.6327. 

Step 1 determines the value of the ripple control factor e: 

1 1 

s = — = = , = 0.1807. 

V30.6327 

Step 2 determines the order N of the Chebyshev polynomial: 

N = cosh -1 [(30. 6327/0. 2588) 0 ' 5 ] = 2 ^ 
cosh’ 1 [100/50] 

We round off N to the closest higher integer, N = 3. 

Step 3 determines the location of the poles and zeros of H(S)H(—S). We 
first determine the location of poles for the Type I Chebyshev filter with s = 
0.1807 and N = 3. Using Eq. (7.47), the location of poles for H{s)H{—s) of 
the Type I Chebyshev filter is given by 

[-0.4468 +jl. 1614, -0.4468 -jl. 1614, 0.4468 +jl. 1614, 0.4468 

— jl . 1614, 0.8935, -0.8935]. 
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Selecting the poles located in the left-half s-plane, we obtain 

[-0.4468 +jl. 1614, -0.4468 +jl. 1614, -0.8935], 

The poles of the normalized Type II Chebyshev filter are located at the inverse 
of the above locations and are given by 

[—0.2885 — j0.7501, -0.2885 +j0.7501, -1.1192], 

The zeros of the normalized Chebyshev Type II filter are computed using 
Eq. (7.60) and are given by 


[-j 1.1547, +j 1.1547, oo]. 


The zero at s = oo is neglected. The transfer function for the normalized 
Type II Chebyshev filter is given by 


H{S) = 


K(S + jl.l547)(5' — j 1.1547) 

(5 + 0.2885 + j0.7501)(S + 0.2885 - j0.7501)(S + 1.1192)’ 


which simplifies to 


H(S) = 


K(S 2 + 1.3333) 

S 3 + 1.6962S 2 + 1.29175 + 0.7229' 


Since \H(co)\ at a = 0 is 1.3333/0.7229 = 1.8444, K is set to 1/1.8444 = 
0.5422 to make the dc gain equal to unity. The new transfer function with unity 
gain at ® = 0 is given by 

= 0.5422(S 2 + 1.3333) 

S 3 + 1.6962S 2 + 1.29175 + 0.7229' 


Step 4 normalizes H(S) based on the following transformation: 

0.5422((s/100) 2 + 1.3333) 

H (s) - H(S)\s= s /ioo - (i/100) 3 + i. 6962 ( 5 ' /100) 2 + 1.2917(^/100) + 0.7229’ 


which simplifies to 


H(s) = 


54.22 (s 2 + 1.3333 x 10 4 ) 

s 3 + 1.6962 x 10 2 s 2 + 1.2917 x 10 4 i + 0.7229 x 10 6 ' 


Step 5 plots the magnitude spectrum, which is shown in Fig. 7.10. As expected, 
the frequency characteristics in Fig. 7.10 have a monotonic gain within the 
pass band and ripples within the stop band. Also, it is noted that the magnitude 
spectrum \H(a>)\ = 0 between the frequencies of co = 100 and <u = 150 radians/s. 
This zero value corresponds to the location of the complex zeros in H(s). Setting 


Fig. 7.10. Magnitude spectrum 
of the Type II Chebyshev lowpass 
filter designed in Example 7.8. 
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the numerator of H( s) equal to zero, we get two zeros at s = ±j 1 15.4686, which 
lead to a zero magnitude at a frequency of a> = 1 15.4686. 


Matlab provides the cheb2ord and cheby2 functions to implement the 
Type II Chebyshev filter. The usage of these functions is the same as the 
cheblord and chebyl functions for the Type I Chebyshev filter except for 
the cheby2 function, for which the stop-band constraints (stop-band ripple rs 
and stop-band corner frequency ws) are specified. The code for Example 7.8 is 
as follows: 

>> wp=50; ws=100; rp=l; rs=15; 

% specify design parameters 
» [N,wn] = cheb2ord (wp, ws , rp, rs , ' s ' ) ; 

% determine order and 
% natural freq 

» [num.den] = cheby2 (N, rs , ws , ' s ' ) ; 

% determine num and denom 
% coeff. 

» Ht = tf (num, den); % determine transfer 


Stepwise implementation of the above code returns the following values for 
different variables: 

Instruction II: N = 3 ; wn = 78.6980; 

Instruction III: num = [0 54.212 0 722835]; 

den = [1.0000 169.63 12917 722835]; 

Instruction IV: Ht = (54.21s~2 + 722800) /(s~3 + 169.6s~2 
+ 12920s + 722800) ; 

The magnitude spectrum is the same as that given in Fig. 7.10. 


Elliptic filters, also referred to as Cauer filters, include both pass-band and stop- 
band ripples. Consequently, elliptic filters can achieve a very narrow bandwidth 
for the transition band. The frequency characteristics of the elliptic filter are 
given by 


73.3.2 Type II Chebyshev filter design using Matlab 


» [H,w] = freqs (num, den) ; 


% function 

% determine magnitude 


» plot (w, abs (H) ) ; 


% spectrum 

% plot magnitude spectrum 


7.3.4 Elliptic filters 


\H(cd)\ = 



(7.62) 


350 


Part II Continuous-time signals and systems 


where U ^(o>) is an /Vth-order Jacobian elliptic function. By setting co p = 1, we 
obtain the frequency characteristics of the normalized elliptic filter as follows: 

1 


\H(a>)\ = 


1 


■ s 2 U 2 N (co) 


(7.63) 


The design procedure for elliptic filters is similar to that for Type I and 
Type II Chebyshev filters. Since Un( 1) = 1, for all /V, it is straightforward 
to derive the value of the ripple control factor as 


— \/Gp, 


(7.64) 


where G P is the pass-band gain term defined in Eq. (7.51). The order N of the 
elliptic filter is calculated using the following expression: 


N = 


#(a> p /« s ) 2 ]i/'L v / i - Gp/GsJ 


(7.65) 


#G P /G s ]#yi - KM) 2 ] ’ 

where i jf[x] is referred to as the complete elliptic integral of the first kind and 
is given by 

71 / 2 

#V = J 


d (f> 


s / 1 — x 2 sin 0 


(7.66) 


Matlab provides the ellipke function to compute Eq. (7.66) such that 
ir[x] = ellipke (x~2 ) . 

Finding the transfer function H(s) for the elliptic filters of order N and 
ripple control factor e requires the computation of its poles and zeros from 
non-linear simultaneous integral equations, which is beyond the scope of the 
text. In Section 7.3.4. 1, which follows Example 7.9, we provide a list of library 
functions in Matlab that may be used to design the elliptic filters. 

Example 7.9 

Calculate the ripple control factor and order of the elliptic filter that satisfies 
the filter specifications listed in Example 7.6. 


Solution 

Example 7.6 computes the gain terms as G p = 0.2588 and G s = 30.6327. The 
pass-band and stop-band corner frequencies are specified as o> p = 50 radians/s 
and a> s = 100 radians/s. Using Eq. (7.65), the ripple control factor is given by 

e = ^G~ = V0. 2588 = 0.5087. 

Using Eq. (7.65) with (o p /u> s = 0.5 and G p /G s = 0.0085, the order N of the 
elliptic filter is given by 

#(« P M) 2 ] W1 - G P /G S J _ V[0.25] #0.9958] 


N = 


#G P /G S ] #y 1 - KM) 2 ] #0.0085] #0.8660] ' 
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Table 7.4. Comparison of the different implementations of a lowpass filter 


Type of filter 

Order 

Pass band 

Transition band 

Stop band 

Butterworth 

highest order (4) 

monotonic gain 

widest width 

monotonic gain 



either pass or stop bands specs are met; the other is overdesigned 

Type I Chebyshev 

moderate order (3) 

ripples are present; 
exact specs are met 

narrow width 

monotonic gain; 
overdesigned specs 

Type II Chebyshev 

moderate order (3); 
same as Type I 

montonic gain; 

overdesigned specs 

narrow width; similar 
to Type I 

ripples are present; 
exact specs are met 

Elliptic 

lowest order (2) 

ripples are present; 
exact specs are met 

narrowest width 

ripples are present; 
exact specs are met 


Using Matlab, t/^ 0.25] = ellipke ( 0 . 25"2 ) = 1.5962, #0. 9958] = 
ellipke ( 0 . 9968~2 ) = 3.9175, #0.0085] = ellipke ( 0 . 0085 ~2 ) = 
1.5708, and #0.8660]= ellipke (0 . 8660"2 ) = 2.1564. The value of 
N is given by 


1.5962 x 3.9715 
1.5708 x 2.1564 


1.8715. 


Rounding off to the nearest higher integer, the order N of the filter equals 2. 


Examples 7.6 to 7.9 designed a lowpass filter for the same specifications based 
on four different implementations derived from the Butterworth, Type I Cheby- 
shev. Type II Chebyshev, and elliptic filters. Table 7.4 compares the properties 
of these four implementations with respect to the frequency responses within 
the pass, transition, and stop bands. 

In terms of the complexity of the implementations, the elliptic filters provide 
the lowest order at the expense of equiripple gains in both the pass and stop 
bands. The Chebyshev filters provide monotonic gain in either the pass or stop 
band, but increase the order of the implementation. The Butterworth filters 
provide monotonic gains of maximally flat nature in both the pass and stop 
bands. However, the Butterworth filters are of the highest order and have the 
widest transition bandwidth. 

Another factor considered in choice of implementation is the phase response 
of the filter. Generally, ripples add non-linearity to the phase responses. There- 
fore, the elliptic filter may not be the best choice in applications where a linear 
phase is important. 


73.4.1 Elliptic filter design using Matlab 

Matlab provides the ellipord and ellip functions to implement the 
elliptic filters. The usage of these functions is similar to the cheblord and 
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chebyl functions used to design Type I Chebyshev filters. The code to imple- 
ment an elliptic filter for Example 7.9 is as follows: 

>> wp=50; ws=100; rp=l; rs=15; 

% specify design parameters 
>> [N,wn] = ellipord (wp,ws,rp,rs, 's') ; 

% determine order and 
% natural freq 

>> [num,den] = el lip (N, rp , rs , wn, ' s ' ) ; 

% determine num and denom 
% coeff. 

>> Ht = tf (num, den); % determine transfer 

% function 

>> [ H , w] = f reqs (num, den) ; % determine magnitude 

% spectrum 

>> plot (w, abs (H) ) ; % plot magnitude spectrum 

Stepwise implementation of the above code returns the following values for 
different variables: 

Instruction II: N = 2 ; wn = 50; 

Instruction III: num = [0.1778 0 2369.66]; 

den = [1.0000 48.384 2961.75]; 

Instruction IV: Ht = (0.1778s'2 + 2640)/(s~2 + 48.38s 
+ 2962) ; 

The magnitude spectrum is plotted in Fig. 7.1 1. 


7.4 Frequency transformations 


In Section 7.3, we designed a collection of specialized CT lowpass filters. In 
this section, we consider the design techniques for the remaining three cat- 
egories (highpass, bandpass, and bandstop filters) of CT filters. A common 
approach for designing CT filters is to convert the desired specifications into 
the specifications of a normalized or prototype lowpass filter using a frequency 
transformation that maps the required frequency-selective filter into a lowpass 
filter. Based on the transformed specifications, a normalized lowpass filter is 
designed using the techniques covered in Section 7.3. The transfer function 
H(S) of the normalized lowpass filter is then transformed back into the original 
frequency domain. Transformation for converting a lowpass filter to a highpass 
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filter is considered next, followed by the lowpass to bandpass, and lowpass to 
bandstop transformations. 


The transformation that converts a lowpass filter with the transfer function H(S) 
into a highpass filter with transfer function H(s) is given by 


where S = a + j&> represents the lowpass domain and s = y + j£ represents 
the highpass domain. The frequency £ = represents the pass-band corner 
frequency for the highpass filter. In terms of the CTFT domain, Eq. (7.67) can 
be expressed as follows: 


Figure 7.12 shows the effect of applying the frequency transformation in 
Eq. (7.68) to the specifications of a highpass filter. Equation (7.68) maps the 
highpass specifications in the range — oo < f < 0 to the specifications of a 
lowpass filter in the range 0 < u> < oo. Similarly, the highpass specifications 
for the positive range of frequencies (0 < £ < oo) are mapped to the lowpass 
specifications within the range — oo < a> < 0. Since the magnitude spectra are 
symmetrical about the y-axis, the change from positive £ frequencies to negative 
u> frequencies does not affect the nature of the filter in the entire domain. 

Highpass to lowpass transformation 


7.4.1 Lowpass to highpass filter 



(7.67) 


s 



(7.68) 




CO 




///////// 


- 1+5, 


Fig. 7.12. Highpass to lowpass 
transformation. 


-£p s, 


o 
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From Fig. 7. 12, it is clear that Eq. (7.68), or alternatively Eq. (7.67), represents 
a highpass to lowpass transformation. We now exploit this transformation to 
design a highpass filter. 

Example 7.10 

Design a highpass Butterworth filter with the following specifications: 

stop band (0 < |£| < 50 radians/s) — 1 dB < 20 log 10 |//(£)| < 0; 
pass band (|§| > 100 radians/s) 201og 10 |//(f )| < — 15dB. 


Solution 

Using Eq. (7.67) with q p = 100 radians/s to transform the specifications from 
the domain s = y + jf of the highpass filter to the domain S = a + ja> of the 
lowpass filter, we obtain 

pass band (2 < \co\ < oo radians/s) — 1 dB < 20 log 10 |//(a))| < 0; 
stop band (| a> \ < 1 radian/s) 201og 10 |//(®)| < 15dB. 

The above specifications are used to design a normalized lowpass Butterworth 
filter. Expressed on a linear scale, the pass-band and stop-band gains are given 
by 


(1 - 5 p ) = 10- 1/2 ° = 0.8913 and S s = lO' 1 ^ 20 = 0.1778. 
The gain terms G p and G s are given by 

G d = „ \ - 1 = — l— r - 1 = 0.2588 


(1 - V 2 


0.8913 2 


and 


G s = 


1 


- 1 = 


1 


- 1 = 30.6327. 


(<5 S ) 2 0.1778 2 

The order N of the Butterworth filter is obtained using Eq. (7.29) as follows: 

1 ln(G p /G s ) 1 ln(0. 2588/30. 6327) 

N — - x = - x = 3.4435. 

2 ln(£p/$ s ) 2 ln(l/2) 


We round off the order of the filter to the higher integer value as IV = 4. 

Using the pass-band constraint, Eq. (7.31), the cut-off frequency of the 
required Butterworth filter is given by 


® s 2 
{G s ) l ' 2N - (30.6327) 1 / 8 


1.3039 radians/s. 
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Fig. 7.13. Magnitude spectrum 
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The poles of the lowpass filter are located at 
S — ( w c exp 


tc (2 n — \)tx 

J 2 +J 8 


for 1 < n < 4. Substituting different values of n yields 

S = [-0.4990 + j 1 .2047 - 1 .2047 + j0.4990 

— j0.4990 -0.4990 -j 1.2047], 

The transfer function of the lowpass filter is given by 

K 

H(S) = 


-1.2047 


(S+0.4490— jl.2047)(S+0.4490+j 1 .2047)15+ 1 .2047-j0.4990)(5+ 1 ,2047+j0.4990) 


or 


H{S) = 


K 


S 4 + 3.4074S 3 + 5.8050S 2 + 5.7934S' + 2.8909' 

To ensure a dc gain of unity for the lowpass filter, we set K = 2.8909. The 
transfer function of a unity gain lowpass filter is given by 

2.8909 

H(S) = 


S 4 + 3.4074S 3 + 5.8050S 2 + 5.7934S + 2.8909' 

To derive the transfer function of the required highpass filter, we use Eq. (7.67) 
with § p = 100 radians/s. The transfer function of the highpass filter is given by 


H(s) = H(S)\s=m/s 


2.8909 


or 


H(s) = 


(100/s) 4 + 3.4074( 100/s) 3 + 5.8050(100A) 2 + 5.7934(100A) + 2.8909 


n 4 + 2.004 x 10 2 i 3 + 2.008 x 10 4 s 2 + 1.179 x 10 6 s + 3.459 x 10 7 ' 


The magnitude spectrum of the highpass filter is given in Fig. 7.13, which 
confirms that the given specifications are satisfied. 


7.4.1. 1 Matlab code for designing highpass filters 

The Matlab code for the design of the highpass filter required in 
Example 7.10 using the Butterworth, Type I Chebyshev, Type II Chebyshev, 
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and elliptic implementations is included below. In each case, MATLAB auto- 
matically designs the highpass filter. No explicit transformations are needed. 

>> % Matlab code for designing highpass filter 
>> wp=100; ws=50; Rp=l; Rs=15; 

% design 

% specifications 

>> % for Butterworth 

% filter 

>> [N, wc] = buttord(wp,ws,Rp,Rs, 's' ) ; 

% determine order 
% and cut off 

>> [numl,denl] = butter (N, wc , 'high ',' s ') ; 

% determine 
% transfer 
% function 

>> HI = tf (numl , deni ) ; 

>> %%%%% % Type I Chebyshev 

% filter 

>> [N, wn] = cheblord (wp, ws , Rp, Rs , ' s ' ) ; 

>> [num2,den2] = chebyl (N, Rp, wn, 'high' , ' s ' ) ; 

>> H2 = tf (num2 , den2 ) ; 

>> %%%%% % Type II Chebyshev 

% filter 

>> [N,wn] = cheb2ord(wp,ws,Rp,Rs, 's' ) ; 

>> [num3,den3] = cheby2 (N, Rs , wn, ' high ' , ' s ' ) ; 

>> H3 = tf (num3 , den3 ) ; 

>> %%%%% % Elliptic filter 

>> [N,wn] = ellipord(wp,ws,Rp,Rs, 's' ) ; 

>> [num4,den4] = ellip (N, Rp , Rs , wn, ' high ' , ' s ' ) ; 

>> H4 = tf (num4 , den4 ) ; 


In the above code, note that wp > ws . Also, an additional argument of ' high ' 
is included in the design statements for different filters, which is used to specify 
a highpass filter. The aforementioned Matlab code results in the following 
transfer functions for the different implementations: 


Butterworth 


H(s) 


s 4 + 2.004 x 10V+ 2.008 x 10 4 s 2 + 1.179 x 10 6 ^ + 3.459 x 10 7 ’ 


Type I Chebyshev 
Type II Chebyshev 


H(s) = 


H(s) = 


s 3 + 252.1s 2 + 2.012 x 10 4 .? + 2.035 x 10 6 ’ 
i 3 + 3.027 x 10 3 i 

+ 1 13.5.v 2 + 9.473 x 10 3 ^ + 3.548 x 10 5 ’ 

0.8903s 2 + 1501 

H(s) = . 

s 2 + 81.68s + 8441 


elliptic 
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The transfer function for the Butterworth filter is the same as that derived by 
hand in Example 7.9. 


7.4.2 Lowpass to bandpass filter 

The transformation that converts a lowpass filter with the transfer function H(S) 
into a bandpass filter with transfer function H(s) is given by 


s T" £pl|fp2 

s (tp2 — §pl) 


(7.69) 


where S = S = a + j&> represents the lowpass domain and s = y + jf repre- 
sents the bandpass domain. The frequency £ = £ p i and £ P 2 represents the two 
pass-band corner frequencies for the bandpass filter with £ p 2 > f p i. In terms of 
the CTFT variables <x> and £, Eq. (7.69) can be expressed as follows: 


£pl£p2 — £ 

S«p2-$pl)' 


From Eq. (7.70), it can be shown that the pass-band corner frequencies £ pl and 
— £ P 2 of the bandpass filter are both mapped in the lowpass domain to co = 1 , 
whereas the pass-band corner frequencies — | p i and f p i are mapped to io = — 1 . 
Also, the pass band £ p i < |§| = £ P 2 of the bandpass filter is mapped to the 
pass band — I < || | < 1 of the lowpass filter. These results can be confirmed 
by substituting different values for the bandpass domain frequencies £ and 
evaluating the corresponding lowpass domain frequencies. 

Considering the stop-band corner frequencies of the bandpass filter, 
Eq. (7.70) can be used to show that the stop-band corner frequency ±f s i is 
mapped to 


£pl£p2 f s i 
£sl(£p2 £p I ) 


(7.71) 


and that the stop-band corner frequency ±§ S 2 is mapped to 


£pl£p2 £ S 2 

£s 2(£ p 2 ~ fpl) 


(7.72) 


As a lower value for the stop-band frequency for the lowpass filter leads to 
more stringent requirements, the stop-band corner frequency for the lowpass 
filter is selected from the minimum of the two values computed in Eqs. (7.71) 
and (7.72). Mathematically, this implies that 


® s = min(a) s i, co s2 ). 


(7.73) 


Example 7.1 1 designs a bandpass filter. 
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Example 7.11 

Design a bandpass Butterworth filter with the following specifications: 

stop band I (0 < |f | < 50 radians/s) 201og 10 |tf (f)| < -20dB; 

pass band (100 < |f| < 200 radians/s) — 2dB < 201og 10 |//(f )| < 0; 
stop band II (|f | > 380 radians/s) 201og 10 |//(f )| < — 20dB. 


Solution 

For f p i = 100 radians/s and f p 2 = 200 radians/s, Eq. (7.70) becomes 

2 x 10 4 - f 2 


co ■ 


lOOf 


to transform the specifications from the domain s — y + jf of the bandpass 
filter to the domain S = o + )co of the lowpass filter. The specifications for the 
normalized lowpass filter are given by 

pass band (0 < \co\ < 1 radian/s) —2 < 20 log 10 | //(&>) | < 0; 
stop band (|<w| > min(3.2737, 3.5) radians/s 201og 10 |//(&))| < —20. 

The above specifications are used to design a normalized lowpass Butterworth 
filter. Expressed on a linear scale, the pass-band and stop-band gains are given 
by 

(1 - ,$ p ) = io- 2/20 = 0.7943 and S s = 10" 20/2 ° = 0.1. 

The gain terms G p and G s are given by 


1 

Gp -(T^ 




i 


0.7943 2 


- 1 = 0.5850 


and 


G s = 


1 


1 = 


1 


1 = 99. 


(<5 S ) 2 0.1778 2 

The order N of the Butterworth filter is obtained using Eq. (7.29) as follows: 

1 ln(G p /G s ) 1 ln(0. 5850/99) 0 

2 ln(fp/f s ) 2 ln( 1/3. 2737) 

We round off the order of the filter to the higher integer value as N — 3. 

Using the stop-band constraint, Eq. (7.31), the cut-off frequency of the low- 
pass Butterworth filter is given by 

® s 3.2737 = 1 5221 radians/s 


(Gs) 1 / 2 *' (99) 1/6 

The poles of the lowpass filter are located at 


S = co c exp 


tc (2 n — 1)tt 

J 2 +J 6 
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Fig. 7.14. Magnitude spectrum 
of the Butterworth bandpass 
filter designed in Example 7.11. 



for 1 < n < 3. Substituting different values of n yields 

S = [-0.7610 +jl. 3182 -0.7610 -jl. 3182 -1.5221], 


The transfer function of the lowpass filter is given by 


H(S) = 


K 

(S + 0.7610 + jl. 31 82)(S + 0.7610 + j 1.31 82)(5 + 1.5221) 


or 


H(S) = 


K 

S 3 + 3.0442S 2 + 4.6336S + 3.5264' 


To ensure a dc gain of unity for the lowpass filter, we set K — 3.5364. The 
transfer function of the unity gain lowpass filter is given by 


H(S) = 


3.5264 

S 3 + 3.0442S 2 + 4.6336S + 3.5264' 


To derive the transfer function of the required bandpass filter, we use Eq. (7.69) 
with § p i = 100 radians/s and q p o = 200 radians/s. The transformation is given 
by 


S = 


s 2 + 2 x 10 4 
100 ^ ’ 


from which the transfer function of the bandpass filter is calculated as follows: 

H(s) = H(S )\ „ ,2 +2 „ 10 4 

100s 

3.5264 


s ! + 2x lO 4 " 13 


100 s 

which reduces to 


3.0442 


s ! + 2x lO 4 " 12 


4.6336 


y + 2x to 4 

iooy 


■ 3.5264 


rir , 3.5264 x 10 6 j 3 

H ^ ~ s 6 + 3.0442 x 10 2 j 5 + 1.0633 x 10 5 s 4 + 1.5703 x 10 7 s 3 +2.1267 x 10’ j 2 + 1.2177 x 10 n s + 8 x 10 12 ' 

The magnitude spectrum of the bandpass filter is given in Fig. 7.14, which 
confirms that the given specifications for the bandpass filter are satisfied. 
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7.4.2. 1 M atlab code for designing bandpass filters 

The M ATLAB code for the design of the bandpass filter required in 
Example 7.11 using the Butterworth, Type I Chebyshev, Type II Chebyshev, 
and elliptic implementations is as follows: 

>> % Matlab code for designing bandpass filter 
>> wp=[100 200]; ws=[50 380]; Rp=2 ; % Specifications 

Rs=2 0 ; 

>> % Butterworth filter 

>> [N, wc] = buttord(wp,ws,Rp,Rs, 's' ) ; 

>> [numl,denl] = butter (N, wc ,' s ') ; 

>> HI = tf (numl , deni ) ; 

>> % Type I Chebyshev filter 

>> [N, wn] = cheblord (wp, ws , Rp, Rs , ' s ' ) ; 

>> [num2,den2] = chebyl (N, Rp, wn, ' s ' ) ; 

>> H2 = tf (num2 , den2 ) ; 

>> % Type II Chebyshev filter 
>> [N,wn] = cheb2ord(wp,ws,Rp,Rs, 's' ) ; 

>> [num3,den3] = cheby2 (N, Rs , wn, ' s ' ) ; 

>> H3 = tf (num3 , den3 ) ; 

>> % Elliptic filter 

>> [N,wn] = ellipord(wp,ws,Rp,Rs, 's' ) ; 

>> [num4,den4] = ellip (N, Rp, Rs , wn, ' s ' ) ; 

>> H4 = tf (num4 , den4 ) ; 


The type of biter is specibed by the dimensions of the pass-band and stop-band 
frequency vectors. Since wp and ws are both vectors, Matlab knows that 
either a bandpass or bandstop biter is being designed. From the range of the 
values within wp and ws, Matlab is also able to differentiate whether a 
bandpass or a bandstop biter is being specibed. In the above example, since 
the range (50-380 Hz) of frequencies specibed within the stop-band frequency 
vector ws exceeds the range (100-200 Hz) specibed within the pass-band fre- 
quency vector wp, Matlab is able to make the bnal determination that a 
bandpass biter is being designed. For a bandstop biter, the converse would hold 
true. 

The aforementioned Matlab code produces bandpass biters with the fol- 
lowing transfer functions: 


Butterworth H(s ) = 


3.526 xlOV 


Type I Chebyshev H(s) = 


,s 6 +304.4.s 5 + 1.063 x 10V+ 1.57 x 10V +2. 127 x 10V+ 1 .218 x 10 n .s+8 x 10 12 ’ 
6.538 x 10V 


s 4 + 80.38s 3 +4.8231 x 10 4 s 2 + 1.608 x 10 6 s + 4 x 10 s ’ 


Type II Chebyshev H(s) = 


0.1s 4 +1.801 x 10V + 4x 10' 


H(s) = 


s 4 + 1.588 x 10 2 s 3 + 5.4010 x 10 4 s 2 + 3.176 x 10 6 s + 4x 10 8 ’ 
0.1s 4 + 1.101 x 10 4 s 2 + 4 x 10 7 


s 4 + 74.67s 3 + 4.8819 x 10 4 s 2 + 1.493 x 10 6 s + 4x 10 s ' 


elliptic 
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Note that the transfer function for the bandpass Butterworth filter is the same 
as that derived by hand in Example 7.9. 


7.4.3 Lowpass to bandstop filter 


The transformation to convert a lowpass filter with the transfer function H(S) 
into a bandstop filter with transfer function H(s ) is given by the following 
expression: 


^(?p2 §pi) 

2 + £plfp2 ’ 


where S = a + jcu represents the lowpass domain and s = y + j? represents 
the bandstop domain. The frequency if = ? pl and ? p 2 represents the two pass- 
band comer frequencies for the bandpass filter with ? p 2 > ? p i. Note that the 
transformation in Eq. (7.74) is the inverse of the lowpass to bandpass transfor- 
mation specified in Eq. (7.69). 

In terms of the CTFT domain, Eq. (7.74) can be expressed as follows: 


_ £(£ P 2 - £pl) 

fpl§p2 - H 2 ’ 


(7.75) 


which can be used to confirm that Eq. (7.74) is indeed a lowpass to bandstop 
transformation. 

As for the bandpass filter, Eq. (7.75) leads to two different values of the 
stop-band frequencies, 


£sl (£p2 £pl) 

and co S 2 = 

§s2(^p2 — £pl) 

£pl£p2 — %sl 


§pl?p2 — f s 2 


(7.76) 


for the lowpass filter. The smaller of the two values is selected as the stop-band 
corner frequency for the normalized lowpass filter. Example 7.12 designs a 
bandstop filter. 


Example 7.12 

Design a bandstop Butterworth filter with the following specifications: 


pass band I (0 < |?| < 100 radians/s) 
stop band (150 < |?| < 250 radians/s) 
pass band II (|?| > 370 radians/s) 


—2 dB < 201og 10 |H(?)| < 0; 

201og 10 |//(?)| < —20 dB; 
-2dB<201og 10 |ff($)| <0. 


Solution 

For £ pl = 100 radians/s and § p 2 = 370 radians/s, Eq. (7.70) becomes 

270 ? 

00 = j -, 

3.7 x 10 4 -? 2 

to transform the specifications from the domain s = y + j? of the bandstop 
filter to the domain S — a + jco of the lowpass filter. The specifications for the 
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normalized lowpass filter are given by 

pass band (0 < \a>\ < 1 radian/s) — 2 < 201og 10 \H(co)\ < 0; 

stop band (|a>| > min(2.7931, 2.6471) radians/s 201og 10 \H(a>)\ < —20. 

The above specifications are used to design a normalized lowpass Butterworth 
filter. Since the pass-band and stop-band gains of the transformed lowpass filter 
are the same as the ones used in Example 7.11, i.e. 

(1 - «5 p ) = 10” 2/2 ° = 0.7943 and S s = lO -20720 = 0.1, 

with gain terms 


G p = 0.5850 


and G s = 99, 


the order IV = 3 of the Butterworth filter is the same as in Example 7.1 1. 

Using the stop-band constraint, Eq. (7.31), the cut-off frequency of the low- 
pass Butterworth filter is given by 

2.6471 


o>s 


(G S )V 2N (99) 1/6 
The poles of the lowpass filter are located at 


= 1.2307 radians/s. 


5 = a> c exp 


' JT (2 n — 1)7T 

J 2 +J 6 


for 1 < n <3. Substituting different values of n yields 

S = [-0.6153 +j0. 06581 -0.6153 - j0.06581 

The transfer function of the lowpass filter is given by 

K 

H(S) = 


1.2307]. 


or 


(S + 0.6153 - j0.06581)(S + 0.6153 + j0.06581)(S + 1.2307) 

K 


H(S) = 


S 3 + 2.4614S 2 + 3.02925’ + 1.8640' 

To ensure a dc gain of unity for the lowpass filter, we set K = 1.8640. The 
transfer function of the unity gain lowpass filter is given by 

1.8640 


H(S) = 


5 3 + 2.46145 2 + 3.02925+ 1.8640' 


To derive the transfer function of the required bandstop filter, we use Eq. (7.74) 
with f p i = 100 radians/s and f p 2 = 370 radians/s. The transfonnation is given 
by 
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Fig. 7.15. Magnitude spectrum 
of the Butterworth bandstop 
filter designed in Example 7.12. 



0 50 100 150 200 250 300 350 400 450 500 


with the transfer function of the bandstop filter is given by 


H(s) = H(5)| s= 270j/i 2 +3.7xl0 4 


1.8640 


270s 


s 2 + 3.7 x 10 4 


■ 2.4641 


270s 


s 2 + 3.7 x 10 4 


■ 3.0292 


270s 


s 2 + 3.7 x 10 4 


-1.8640 


which reduces to 

s 6 +l.llx 10V+4.107xl0 9 s 2 +5.065xl0 13 

iS) ~ s 6 +4.388x 10 2 s 5 + 2.07 37x 10 5 s 4 +4.302x 10 7 s 3 + 7.673 x 10 1, s 2 +6 x 10 u .s + 5.065 x 10 13 ' 

The magnitude spectrum of the bandstop filter is included in Fig. 7.15, which 
confirms that the given specifications are satisfied. 


7.4.3.1 Matlab code for designing bandstop filters 

The Matlab code for the design of the bandstop filter required in 
Example 7.12 using the Butterworth, Type I Chebyshev, Type II Chebyshev, 
and elliptic implementations is as follows: 

% Matlab code for designing bandstop filter 
» wp=[100 370]; ws=[150 250]; Rp=2 ; Rs=20; 

% Specifications 

» % Butterworth Filter 
» [N, wn] = buttord(wp,ws,Rp,Rs, 's' ) ; 

» [numl,denl] = butter (N,wn, 'stop', 's'); 

» HI = tf (numl , deni ) ,- 

» % Type I Chebyshev filter 

» [N, wn] = cheblord(wp,ws,Rp,Rs, 's' ) ; 

» [num2,den2] = chebyl (N, Rp, wn, 'stop', 's'); 

» H2 = tf (num2 , den2 ) ,- 
» % Type II Chebyshev filter 
» [N,wn] = cheb2ord(wp,ws,Rp,Rs, 's' ) ; 

» [num3,den3] = cheby2 (N, Rs , wn, 'stop', 's'); 

» H3 = tf (num3 , den3 ) ; 

» % Elliptic filter 

» [N,wn] = ellipord(wp,ws,Rp,Rs, 's' ) ; 

» [num4,den4] = ellip (N, Rp , Rs , wn, 'stop', 's'); 

H4 = tf (num4 , den4 ) ,- 


>> 
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The aforementioned Mat LAB code produces the following transfer functions 
for the four filters: 


Butterworth H(s ) = 


s 6 + 1 . 125 x 10 5 j 4 +4.219 x 10V+5.273 x 10 13 


Type I Chebyshev H(s) = 
Type II Chebyshev H(s ) = 
elliptic H(s) = 


s 6 +430. 2s 5 +2.05 x 10 5 5 4 +4.221 x 10V+7.688 x 10 9 s 2 +6.049x 10 n i+5.273 x 10 13 ’ 
0.7943 j 4 + 5.957 x 10V + 1.117 x 10 9 


j 4 + 262.4i 3 + 1.627 x 1 0 s j 2 +9.839 x 10 6 s + 1.406 x 10 9 ’ 

0.7943s 4 + 8.015 x 10 4 s 2 + 1.406 x 10 9 
s 4 + 304.5s 3 + 1.265 x 10 5 s 2 + 1.142 x 10 6 s + 1.406 x 10 9 ’ 

0.7943s 4 + 6.776 x 10 4 s 2 + 1.117 x 10 9 
s 4 + 227.5s 3 + 1.568 x 10 5 s 2 + 8.53 x 10 6 s + 1.406 x 10 9 ' 


7.5 Summary 


Chapter 7 defines the CT filters as LTI systems used to transform the frequency 
characteristics of the CT signals in a predefined manner. Based on the magnitude 
spectrum \H(co)\, Section 7.1 classifies the frequency-selective filters into four 
different categories. 

(1) An ideal lowpass filter removes frequency components above the cut-off 
frequency <w c from the input signal, while retaining the lower frequency 
components to < co c . 

(2) An ideal highpass filter is the converse of the lowpass filter since it removes 
frequency components below the cut-off frequency &> c from the input signal, 
while retaining the higher frequency components to < co c . 

(3) An ideal bandpass filter retains a selected range of frequency components 
between the lower cut-off frequency co c i and the upper cutoff frequency 
to c 2 of the filter. All other frequency components are eliminated from the 
input signal. 

(4) A bandstop filter is the converse of the bandpass filter, which rejects all 
frequency components between the lower cut-off frequency to c i and the 
upper cut-off frequency a > c 2 of the filter. All other frequency components 
are retained at the output of the bandstop filter. 

The ideal frequency filters are not physically realizable. Section 7.2 introduces 
practical implementations of the ideal filters obtained by introducing ripples 
in the pass and stop bands. A transition band is also included to eliminate the 
sharp transition between the pass and stop bands. 

In Section 7.3, we considered the design of practical lowpass filters. We pre- 
sented four implementations of practical filters: Butterworth, Type I Chebyshev, 
Type II Chebyshev, and elliptic filters, for which the design algorithms were 
covered. The Butterworth filters provide a maximally flat gain within the pass 
band but have a higher-order N than the Chebyshev and elliptic filters designed 
with the same specifications. By introducing ripples within the pass band, 
Type I Chebyshev filters reduce the required order N of the designed filter. 
Alternatively, Type II Chebyshev filters introduce ripples within the stop band 
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to reduce the order N of the filter. The elliptic filters allow ripples in both the 
pass and stop bands to derive a filter with the lowest order N among the four 
implementations. Matlab instructions to design the four implementations 
are also presented in Section 7.3. 

In Section 7.4, we covered three transformations for converting a highpass 
filter to a lowpass filter, a lowpass to a bandpass filter, and a bandstop to a lowpass 
filter. Using these transformations, we were able to map the specifications of 
any type of the frequency-selective filters in terms of a normalized lowpass 
filter. After designing the normalized lowpass filter using the design algorithms 
covered in Section 7.3, the transfer function of the lowpass filter is transformed 
back into the original domain of the frequency-selective filter. 


Problems 


7.1 Determine the impulse response of an ideal bandpass filter and an ideal 
bandstop filter. In each case, assume a gain of A within the pass bands and 
cut off frequencies of a> c \ and w C 2 ■ 

7.2 Derive and sketch the location of the poles for the Butterworth filters of 
orders N = 12 and 13 in the complex s-plane. 

7.3 Show that a lowpass Butterworth filter with an odd value of order N will 
always have at least one pole on the real axis in the complex s-plane. 

7.4 Show that all complex poles of the lowpass Butterworth filter occur in 
conjugate pairs. 


7.5 Show that the Ath -order Type I Chebyshev polynomial Ts (o>) has A simple 
roots in the interval [—1, 1], which are given by 

'(2 n + 1)jt ’ 


w„ = cos 


2 A 


0 < n < A - 1. 


7.6 Show that the roots of the characteristic equation 


1 +s 2 7^(j/s) = 0 


for the Type II Chebyshev filter are the inverse of the roots of the charac- 
teristic equation 

l+e 2 r 2 ( s /j) = 0 


for the Type I Chebyshev filter. 

7.7 Design a Butterworth lowpass filter for the following specifications: 


pass band (0 < M < 10 radians/s) 0.9 < \H(co)\ < 1; 
stop band (|a>| > 20 radians/s) \H(co)\ < 0.10, 
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by enforcing the pass-band requirements. Repeat for the stop-band 
requirements. Sketch the magnitude spectrum and confirm that the mag- 
nitude spectrum satisfies the design specifications. 

7.8 Repeat Problem 7.7 for the following specifications: 

pass band (0 < M < 50 radians/s) — 1 < 201og 10 |//(®)| < 0; 
stop band (|&>| > 65 radians/s) 20 log 10 | H(co)\ < —25. 

7.9 Repeat (a) Problem 7.7 and (b) Problem 7.8 for the Type I Chebyshev 
filter. 

7.10 Repeat (a) Problem 7.7 and (b) Problem 7.8 for the Type II Chebyshev 
filter. 

7.11 Determine the order of the elliptic filters for the specifications included 
in (a) Problem 7.7 and (b) Problem 7.8. 

7.12 Using the results in Problems 7.7-7.11, compare the implementation 
complexity of the Butterworth, Type I Chebyshev, Type II Chebyshev, 
and elliptic filters for the specifications included in (a) Problem 7.7 and 
(b) Problem 7.8. 

7.13 By selecting the comer frequencies of the pass and stop bands, show that 
the transformation 

g _ s(£p2 — fpl) 

■S 2 + ?plfp2 

maps a normalized lowpass filter into a bandstop filter. 

7.14 Design a Butterworth highpass filter for the following specifications: 

stop band (0 < M < 15 radians/s) \H(co)\ <0.15; 
pass band (|a>| > 30 radians/s) 0.85 < \H(a))\ < 1. 

Sketch the magnitude spectrum and confirm that it satisfies the design 
specifications. 

7.15 Repeat Problem 7.14 for the Type I Chebyshev filter. 

7.16 Repeat Problem 7. 14 for the Type II Chebyshev filter. 

7.17 Design a Butterworth bandpass filter for the following specifications: 
stop band I (0 < |£| < 100 radians/s) 20 log 10 |//(w)| < —15; 
pass band (100 < |£| < 150 radians/s) — 1 < 20 log 10 | //(&>) | < 0; 
stop band II (|^| > 175 radians/s) 20 log 10 | //(&>) | < —15. 

Sketch the magnitude spectrum and confirm that it satisfies the design 
specifications. 

7.18 Repeat Problem 7.17 for the Type I Chebyshev filter. 
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7.19 Repeat Problem 7.17 for the Type II Chebyshev filter. 

7.20 Design a Butterworth bandstop filter for the following specifications: 

pass band I (0 < ] < 25 radians/s) —4 < 20 log 10 |//(w)| < 0; 

stopband (100 < |§| < 250 radians/s) 201og 10 |//(ct>)| < —20; 
pass band II (|£| > 325 radians/s) —4 < 201og 10 |//(o>)l < 0. 

Sketch the magnitude spectrum and confirm that it satisfies the design 
specifications. 

7.21 Repeat Problem 7.20 for the Type I Chebyshev filter. 

7.22 Repeat Problem 7.20 for the Type II Chebyshev filter. 

7.23 Determine the transfer function of the four implementations: (a) Butter- 
worth, (b) Type I Chebyshev, (c) Type II Chebyshev, and (d) elliptic, of 
the lowpass filter specified in Problem 7.7 using Matlab . Plot the fre- 
quency characteristics and confirm that the specifications are satisfied by 
the designed implementations. 

7.24 Determine the transfer function of the four implementations: (a) Butter- 
worth, (b) Type I Chebyshev, (c) Type II Chebyshev, and (d) elliptic, of 
the lowpass filter specified in Problem 7.8 using Matlab . Plot the fre- 
quency characteristics and confirm that the specifications are satisfied by 
the designed implementations. 

7.25 Determine the transfer function of the four implementations: (a) Butter- 
worth, (b) Type I Chebyshev, (c) Type II Chebyshev, and (d) elliptic, of 
the highpass filter specified in Problem 7.14 using MATLAB. Plot the 
frequency characteristics and confirm that the specifications are satisfied 
by the designed implementations. 

7.26 Determine the transfer function of the four implementations (a) Butter- 
worth, (b) Type I Chebyshev, (c) Type II Chebyshev, and (d) elliptic, of 
the bandpass filter specified in Problem 7.17 using Matlab. Plot the 
frequency characteristics and confirm that the specifications are satisfied 
by the designed implementations. 

7.27 Determine the transfer function of the four implementations: (a) Butter- 
worth, (b) Type I Chebyshev, (c) Type II Chebyshev, and (d) elliptic, of 
the bandstop filter specified in Problem 7.20 using Matlab. Plot the 
frequency characteristics and confirm that the specifications are satisfied 
by the designed implementations. 


CHAPTER 



Case studies for CT systems 


Several aspects of continuous-time (CT) systems were covered in Chapters 
3-7. Among the concepts covered, we used the convolution integral in 
Chapter 3 to determine the output y(t ) of a linear time-invariant, continuous- 
time (LTIC) system from the input signal x(f) and the impulse response h(t). 
Chapters 4 and 5 defined the frequency representations, namely the CT Fourier 
transform (CTFT) and the CT Fourier series (CTFS) and evaluated the out- 
put signal y(t) of the LTIC system in the frequency domain. The CTFT was 
also used to estimate the frequency characteristics of the LTIC system by plot- 
ting the magnitude and phase spectra. Chapter 6 introduced the Laplace trans- 
form widely used as an alternative for the CTFT in control systems, where 
the analysis of the transient response is of paramount importance. Chapter 7 
presented techniques for designing LTIC systems based on the specified fre- 
quency characteristics. When an LTIC system is described in terms of its fre- 
quency characteristics, it is referred to as a frequency-selective filter. Design 
techniques for four types of analog filters, lowpass filters, highpass filters, band- 
pass filters, and bandstop filters, were also covered in Chapter 7. In this chap- 
ter, we provide applications for the LTIC systems. Our goal is to illustrate 
how the tools developed in the earlier chapters can be utilized in real-world 
applications. 

The organization of this chapter is as follows. Section 8.1 considers analog 
communication systems. In particular, we illustrate the use of amplitude modu- 
lation in communication systems for transmitting information to the receivers. 
Based on the CTFT, spectral analysis of the process of modulation provides 
insight into the performance of the communication systems. Section 8.2 intro- 
duces a spring damper system and shows how the Laplace transform is useful 
in analyzing the stability of the system. Section 8.3 analyzes the armature- 
controlled, direct current (dc) motor by deriving its impulse response and trans- 
fer function. The immune system of humans is considered in Section 8.4. Ana- 
lytical models for the immune system are considered and later analyzed using 
the simulink toolbox available in Matl AB . 
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Fig. 8.1. Schematic diagram 
modeling the process of 
amplitude modulation. 


m(t) — ► 
modulating 
signal 


attenuator 


km{t) 
>1 


<+> 


{ 1 +km(t)) 

* 

modulator 

— ►s(t) 




k — 

signal 


modulation 


A cos(2jtf c t) 


8.1 Amplitude modulation of baseband signals 


Section 2.1.3 introduced modulation as a frequency-shifting operation where 
the frequency contents of the information-bearing signal are moved to a higher 
frequency range. Modulation leads to two main advantages in communications. 
First, since the length of the antenna is inversely proportional to the frequency 
of the information signal, transmitting information bearing low-frequency 
baseband signals directly leads to antennas with impractical lengths. By shift- 
ing the frequency content of the information signal to a higher frequency range, 
the length of the antenna is considerably reduced. Secondly, modulation leads 
to frequency division multiplexing (FDM), where multiple signals are coupled 
together by shifting them to a range of different frequencies and are then trans- 
mitted simultaneously. This provides considerable savings in the transmission 
time and the power consumed by the communication systems. In this section, 
we consider a common form of modulation, referred to as amplitude modulation 
(AM), used frequently in radio communications. 

Amplitude modulation is a popular technique used for broadcasting radio 
stations within a local community. In North America, a frequency range of 520 
to 1710 kHz is assigned to the AM stations. Typically, each station occupies a 
bandwidth of 10 kHz. To limit the range of transmission to a few kilometers, 
the transmitted power for a station ranges from 0. 1 to 50 kW, such that the same 
AM band can be reused by another community without interference. In this 
section, we use the CTFT to analyze AM-based communication systems. 

A schematic diagram of an AM system is shown in Fig. 8.1, where m(t) 
represents a baseband signal with non-zero frequency components within the 
range -® max < u> < ® max . The output of the AM system is given by 

s(t ) — A[1 + km(t)\ cos(o) f f + (p c ). (8.1) 

The multiplication term A cos (a> c t + <p c ) represents the sinusoidal earner, 
whose amplitude is denoted by A, and the radian frequency is given by 
co c = 2: r/ c j The constant phase term (/>, is referred to as the epoch of the carrier, 
while the factor k is referred to as the modulation index, which is adjusted such 
that the intermediate signal (1 + km(t)) is always positive for all t > 0. 

* Note that co c represents the fundamental frequency of the sinusoidal carrier signal c(l). and 
should not be confused with co c , used to denote the cut-off frequency of the CT filter. 
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Fig. 8.2. Amplitude modulation 
in time domain for two different 
modulating signals: (a) pure 
sinusoidal signal with 
fundamental frequency of 2 kHz; 
(b) synthetic audio signal. The 
modulated signal for the pure 
sinusoidal signal is shown in (c) 
and that for real speech is 
shown in (d). 


Figure 8.2 shows the results of amplitude modulation for two different modu- 
lating signals: a pure sinusoidal signal with the fundamental frequency of 2 kHz 
is plotted in Fig. 8.2(a) and a synthetic audio signal is plotted in Fig. 8.2(b). Both 
signals are amplitude modulated with the carrier signal cos (a> c t + <p c ) having 
a fundamental frequency of f c = 40 kHz and an epoch of <f> c = 0 radians. In 
the case of the pure sinusoidal signal, the modulation index k is selected to 
have a value of 0.2, while for the real audio signal the modulation index is set 
to 0.7. The results of amplitude modulation are shown in Fig. 8.2(c) for the 
pure sinusoidal signal and in Fig 8.2(d) for the audio signal. In both cases, we 
observe that the amplitude of the carrier signal is adjusted according to the 
magnitude of the modulating signal. In other words, the modulating signal acts 
as an envelope and controls the amplitude of the carrier. 

To illustrate the effect of modulation on the frequency content of the modu- 
lating signal, we use the CTFT. Equation (8.1) is expressed as follows: 


s(t ) = A cos (co c t + <t> c ) + Akm(t) cos (a> c t + (j> c )- (8.2) 

Without loss of generality, we set A — 1 and c/j, = 0. Using the multiplication 
property for the CTFT, we obtain 

1 

S(cd) = 7t[<5(&> — a> c ) + S(a> + <w c )] + -k[M(co — co c ) + M(a> + &> c )]. (8.3) 

Equation (8.3) proves that the spectrum of the modulated signal s(t ) is the 
sum of three components: the scaled spectrum of the carrier signal, the scaled 
replica of the modulating signal m(t) shifted to +a> c , and the scaled replica of 
the modulating signal m(t ) shifted to —co c . This result is illustrated in Fig. 8.3(c) 
for the baseband signal m(t), which is band-limited to &> max and has the spectrum 
shown in Fig. 8.3(a). The two replicas of the CTFT M(o>) of the modulating 
signal in Fig. 8.3(c) are referred to as the side bands of the AM signal. 
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Fig. 8.3. Amplitude modulation 
in the frequency domain. 

(a) Spectrum of the baseband 
information signal. 

(b) Spectrum of the carrier 
signal, (c) Spectrum of the 
modulated signal. 





(c) 


We now consider the extraction of the information signal x(t) from the mod- 
ulated signal s(t). This procedure is referred to as demodulation, which is 
explained in Sections 8.1.1 and 8.1.2. 


8.1.1 Synchronous demodulation 

The objective of demodulation is to reconstruct m(t) from s(t). Analyzing the 
spectrum S(o>) of the modulated signal s(t), the following method extracts the 
information-bearing signal m(t ) from s(t). 

(1) Frequency shift the modulated signal s(t) by a> c (or — a> c ). If the modulated 
signal is frequency-shifted by u> c , one of the side bands is shifted to zero 
frequency, while the second side band is shifted to 2 co c . Conversely, if 
the modulated signal is frequency-shifted by —co c , the two side bands are 
shifted to zero and —2 co c . 

(2) In order to remove the side band shifted to the non-zero frequency, the 
result obtained in Step (1) is passed through a lowpass filter having a pass 
band of (— u> mm < a> < &) max ). The output of the lowpass filter consists 
of a scaled version of the modulating signal and an impulse at a> = 0. 
The impulse represents the dc component and is removed by subtracting a 
constant value in the time domain as shown in Step (3). 

(3) A constant voltage equal to the dc component is subtracted from the output 
of the lowpass signal. 

Step (1) can be performed by multiplying the AM signal s(t) by the demodulat- 
ing carrier cos(® c f) having the same fundamental frequency and phase as the 
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M(<o) c (®) 



Fig. 8.4. Demodulation in the 
frequency domain, (a) Spectrum 
of the modulated signal. 

(b) Spectrum of the carrier 
signal, (c) Spectrum of the 
demodulated signal. 


modulating carrier. In the time domain, the result of the multiplication is given 
by 


d(t) = s(t)c(t ) = [cos (co c t) + km{t) cos(<w c f )] cos (co c t), (8.4) 

which is expressed as 


1 1 

d(t) — s(t)c(t) = -[1 + km(t)] + -[1 + km{t)] cos(2o> c f) . (8.5) 

V ' v- ' 

dlow(t) ^high(r) 


Equation (8.5) shows that the demodulated signal d(t) has two components. 
The first component d\ ov/ (t) is the low-frequency component, which consists of 
a constant factor of 1 / 2 and a scaled replica of the modulated signal. The second 
component c/hi g h(0 is the higher-frequency component and can be filtered out, 
as explained next. Taking the CTFT of Eq. (8.5) yields 


1 vk 

D(co) = — [S(a>) * C(co)] = 7r<5(tt>) H — M(a>) 
2n L 2 


<4>w(r ) 


“h — 2cu c ) T ~ 47 (ro — 2cu c )^ T j^^"*5(cu T 2 cu c ) T — M (co T 2cu c )^ , 


<^high(^ ) 


( 8 . 6 ) 


which is plotted in Fig. 8.4(c). Recall that Fig. 8.4(a) represents the spectrum 
of the modulated signal m(t) and that Fig. 8.4(b) represents the spectrum of the 
carrier signal c(t). By filtering d(t) with a lowpass filter having a pass band of 
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— a> c < co < co c , the lowpass component du m (t) is extracted. The information 
signal m(t) is then obtained from (l\ ow (t) using the following relationship: 

m(t) = 2[4 OW (0 - 1]. (8-7) 


8.1.2 Synchronous demodulation with non-zero epochs 

In synchronous demodulation, the epoch (p c of the modulating carrier is assumed 
to be identical to the epoch of the demodulating carrier. In practice, perfect syn- 
chronization between the carriers is not possible, which leads to distortion in 
the signal reconstructed from demodulation. To illustrate the effect of distor- 
tion introduced by unsynchronized carriers, consider the following modulated 
signal: 


s(t ) = A cos (co c t + (p c ) + Akm(t ) cos (co c t + cp c ), (8.8) 

as derived in Eq. (8.2). Assume that the demodulator carrier is given by 

c 2 (t) — A cos ((o c t + 9 c (t)), (8.9) 

which has a time-varying epoch 9 c {t ) ^ </>, . Using c 2 (t), the demodulated signal 
is given by 


d(t) = s(t)c 2 {t) = [A cos(o> c f +</> c ) + Akm(t) cos(® c f + cp c )] cos(a> c f +6 c (t)), 

(8.10) 

which simplifies to 

A A 

d(t) = — [1 + km(t)] cos ((p c — 0 c (t))+ — [1 + km(t)\ cos(2<w c f + (p c + 0 c (t)). 


^low (f ) ^high (?) 

(8.11) 

Equation (8.11) illustrates that the demodulated signal contains a low-frequency 
component d\ my (t) and a higher-frequency component £/high(0- By passing the 
demodulated signal through a lowpass filter, the higher-frequency component 
is removed. The output of the lowpass filter is given by 


y(t) = — [1 + km(t )] cos (cp c - 0 C {1)). 


(8.12) 


Even after eliminating the dc component, the reconstructed signal has the fol- 
lowing form: 


y(t) = -km{t)cos{(p c - 6 c (t)), 


(8.13) 


where distortion is caused by the factor of cos (cp c — 9 c {t)). Since the epoch 
0 c (t) is time-varying, it is difficult to eliminate the distortion. To reconstruct 
x(t ) precisely, the phase difference between the carrier signals used at the mod- 
ulator and demodulator must be kept equal to zero over time. In other words, 
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Fig. 8.5. Asynchronous AM 
demodulation, (a) RC parallel 
circuit coupled with a diode to 
implement the envelope 
detector, (b) Reconstructed 
signal d(t) is shown as a solid 
line. For comparison, the 
information component 
[1 + km(t)] is shown as the 
envelope of the AM signal 
(dashed line). 


perfect synchronization between the modulator and demodulator is essential to 
retrieve the information signal m(t). For this reason, the aforementioned mod- 
ulation scheme based on multiplying the modulated signal by the carrier signal 
and lowpass filtering is referred to as synchronous demodulation. Although syn- 
chronous demodulation is an elegant way of retrieving the information signal 
mil), the demodulator has a high implementation cost due to the synchroniza- 
tion required between the two carriers. An alternative scheme, which does not 
require synchronization of the modulating and demodulating carriers, is referred 
to as asynchronous demodulation, which is considered in the following section. 


8.1.3 Asynchronous demodulation 

In amplitude modulation, the information-bearing signal m(t) modulates the 
magnitude of the carrier signal c(t). This is illustrated in Figs. 8.2(c) and (d), 
where the envelope of the amplitude modulated signal follows the informa- 
tion component [1 + km(t)]. In asynchronous demodulation, we reconstruct 
the information signal m(t ) by tracking the envelope of the modulated signal. 

Figure 8.5(a) shows a parallel RC circuit used to reconstruct the information- 
bearing signal m{t) from the amplitude modulated signal sit) applied at the input 
of the RC circuit. The diode acts as a half-wave rectifier removing the negative 
values from the modulated signal, while the capacitor C tracks the envelope 
of the AM signal by charging to the peak of the sinusoidal carrier during the 
positive transition of the signal. During the negative transitions of the carrier, 
the capacitor discharges slightly, but is again recharged by the next positive 
transition. The process is illustrated in Fig. 8.5(b), where the demodulated signal 
is represented by a solid line. We observe that the demodulated signal closely 
follows the envelope of the modulated signal and is a good approximation of 
the information-bearing signal. 


8.2 Mechanical spring damper system 


The spring damping system, considered in Section 2.1.5, is a classic example 
of a second-order system; the schematic diagram for such a system is shown in 
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Fig. 8.6. The input-output relationship of the spring damping system is given 
by Eq. (2.16), which for convenience of reference is repeated below: 

d 2 y dy 

M— +r— + ky(t) = x(t). (8.14) 

df dr 

In Eq. (8.14), M is the mass attached to the spring, r is the frictional coefficient, 
k is the spring constant, x(t) is the force applied to pull the mass, and y(f) is 
the displacement of the mass caused by the force. In this section, we analyze 
the spring damping system using the methods discussed in Chapters 5 and 6. 
Using the Laplace transform, the transfer function determines the stability of 
the system. 


8.2.1 Transfer function 


Taking the Laplace transform of both sides of Eq. (8.14) and assuming zero 
initial conditions, we obtain 


(Ms 1 + rs + k)Y(s) — X(s), (8.15) 


which results in the following transfer function: 

Y(s) 1 


H(s) = 


X(s) ( Ms 2 + rs+k ) 
Alternatively, Eq. (8.16) can be expressed as follows: 

1/M 1/M 


H(s) = 


s 2 + ( r/M)s + k/M s 2 + 2 % n co„s + co 2 


(8.16) 


(8.17) 


where 


spring ^ 
constant 

wall 

friction 
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Fig. 8.6. Mechanical spring 
damping system. 
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The characteristic equation of the mechanical spring damping system is given 
by 


.s 2 + 2£„a)„,y + o)l = 0, (8.18) 

which has two poles at 

P\ = fc, n co n 4 “ o>„ // 1 and p2 — co n 1 - (8.19) 

Depending on the value of the poles p\ and pi may lie in different locations 
within the s-plane. If = 1, poles p\ and pi are real-valued and identical. If 
> 1, poles p i and pi are real-valued but not equal. Finally, if < 1, poles 
pi and pi are complex conjugates of each other. In the following, we calculate 
the impulse response h(t) of the spring damping system for three sets of values 
of and show that the characteristics of the system depend on the value of . 
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Case 1 (£„ = 1) For %„ = 1, Eq. (8.17) reduces to 

1/M 1/M 


H(s) = 


( 8 . 20 ) 


s 2 + 2co n s + a> 2 ( s + co n ) 2 ’ 

with repeated roots at s = —co n , —w n .Taking the inverse transform, the impulse 
response is given by 

1 


hit ) = —te-^’uit). 
M 


( 8 . 21 ) 


Case 2 (£„ > 1) For > 1, the poles p\ and p 2 of the spring damping system 
are real-valued and given by 

Pi = T tO n t; 2 1 and P2 = to n ■// 1 . (8.22) 

The transfer function of the spring damping system can be expressed as follows: 

1/M 1/M 

H{s) = - = , (8.23) 

s 2 + 2% n co n s + ml {s - pi)(s - p 2 ) 

which leads to the impulse response 

hit) = [e pit - e P2 '] u(t) = »-^nt 


M ip x - p 2 ) 


x e 


t _ 1 t 


2co n M^^l 
nit). 


(8.24) 


Case 3 (&, < 1) For > 1, the poles p\ and p 2 of the spring damping system 
are complex and are given by 


Pi — -f- j<x>/ 7 ^/l l^ 2 and p 2 — ^ n (*) n . (8.25) 


By repeating the procedure for Case 2, the impulse response of the spring 
damping system is given by 


His) = 


1/M 


1/M 


s 2 + 2 % n co„s + (o 2 is - pi)is - p 2 ) ’ 
which leads to the impulse response 
1 


(8.26) 


hit) = 


oj n M y /\ - 


sin [«„y 1 - |2 r] uit). (8.27) 


Figure 8.7 shows the impulse response of the spring damping system for the 
three cases considered earlier. We set M = 10 and o>„ = 0.3 radians/s in each 
case. For Case 1 with §„ = 1, the impulse response decreases monotonically 
approaching the steady state value of zero. Such systems are referred to as 
critically damped systems. 

For Case 2 with = 4, the impulse response of the spring damping system 
again approaches the steady state value of zero. Initially, the deviation from the 
steady state value is smaller than that of the critically damped system, but the 
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Fig. 8.7. Impulse responses of Q 2 

the spring damping system for h(t) 

M = 10 and w n = 0.3. 0 -' 
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overall duration over which the steady state value is achieved is much longer. 
Such systems are referred to as overdamped systems. 

For Case 3 with §„ = 0.2, the spring acts as a flexible system. The impulse 
response approaches the steady state value of zero after several oscillations. 
Such systems are referred to as underdamped systems. Since the fundamental 
frequency co„ is 0.3 radians/s, the period of oscillation is given by 

2n 2 jt 

T — — = — = 21.95 seconds. (8.28) 

(O n 0.3 

Based on Eq. (8.28), parameter co„ is referred to as the fundamental frequency of 
the spring damping system. Since parameter £„ determines the level of damping, 
it is referred to as the damping constant. 


8.3 Armature-controlled dc motor 


Electrical motors form an integral component of most electrical and mechan- 
ical devices such as automobiles, ac generators, and power supplies. Broadly 
speaking, electrical motors can be classified into two categories: direct current 
(dc) motors and alternating current (ac) motors. Within each category, there are 
additional subclassifications covering different applications. In this section, we 
analyze the armature-controlled dc motor by deriving its transfer function and 
impulse response. 

Figure 8.8(a) shows an armature-controlled dc motor, in which an armature, 
consisting of several copper conducting coils, is placed within a magnetic field 
generated by a permanent or an electrical magnet. A voltage applied across the 
armature results in a flow of current through the armature circuit. Interaction 
between the electrical and magnetic fields causes the armature to rotate, the 
direction of rotation being determined by the following empirical rule, derived 
by Faraday. 

Extend the thumb, index finger, and middle linger of the right hand such that 
the three are mutually orthogonal to each other. If the index finger points in the 
direction of the current and the middle finger in the direction of the magnetic 
field, then the thumb points in the direction of motion of the armature. 
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Fig. 8.8. Armature-controlled dc 
motor, (a) Cross-section; (b) 
schematic representation. 
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8.3.1 Mathematical model 

The linear model of the armature-controlled dc motor is shown in Fig. 8.8(b), 
where a load J is coupled to the armature through a shaft. Rotation of the arma- 
ture of the dc motor causes the desired motion in the attached load J . Moving 
a conductor within a magnetic held also generates a back electromagnetic held 
(emf) to be induced in the dc motor. The back emf results in an opposing emf 
voltage, which is denoted by Vemf in Fig. 8.8(b). In the following analysis, we 
decompose the motors into three components: armature, motor, and load. The 
equations for the three components are presented below. 


Armature circuit Applying Kirchhoff’s voltage law to the armature circuit, 
we obtain 


L^ + RJ* + k[Oj(t) = V a (f), (8.29) 

wo 

where VJj ) denotes the armature voltage and ; a (r) denotes the armature current. 
The electrical components of the armature circuit are given by L d and R d , where 
L d denotes the self inductance of the armature and R d denotes the self resistance 
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of the armature. The emf voltage Vemf(0 is approximated by the product of the 
feedback factor kf and the angular velocity co(t). 

Motor circuit The torque T m , induced by the applied voltage across the arma- 
ture, is given by 


Tm = (8-30) 

where k m is referred to as the motor or armature constant and /' a (f ) is the armature 
current. The armature constant k m depends on the physical properties of the dc 
motor such as the strength of the magnetic field and the density of the armature 
coil. 

Load The load component of the dc motor is obtained by applying Newton’s 
third law of motion, which states that the sum of the applied and reactive forces 
is zero. The applied forces are the torques around the motor shaft. The reactive 
force causes acceleration of the armature and equals the product of the inertial 
load J and the derivative of the angular rate co(t). In other words, 

E d ol) 

= (8.31) 

p 

where J denotes the inertia of the rotor. There are three different torques, i.e. 
p = 3, observed at the shaft: (i) motor torque 7 m represented by Eq. (8.30); (ii) 
frictional torque 7) given by rco(t), r being the frictional constant; and (iii) load 
disturbance torque T&. In other words, Eq. (8.31) can be expressed as follows: 

J^- = T m - rco(t) - T d . (8.32) 

dr 

Since the angular velocity co(t) is related to the shaft position 0(t) by the fol- 
lowing expression: 

d0 

o>(t)=- (8.33) 

dr 

Eq. (8.32) can be expressed as follows: 
d 2 d d 0 

J “7T + r — = T m — T d = t l, (8.34) 

d t z dr 

where 7f denotes the difference between the motor torque 7 nl and the load 
disturbance torque T d . 


8.3.2 Transfer function 


The dc motor shown in Fig. 8.8 is modeled as a linear time-invariant (LTI) 
system with the armature voltage v a (r) considered as the input signal and the 
shaft position 0(t) as the output signal. We now derive the transfer function of 
the linearized model. 
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Taking the Laplace transform of Eq. (8.29) yields 

[sL d + /? a ] / a (s) + kffi(s) = V a (s), (8.35) 

where V a (s), 7 a (s), and l?(s) are the Laplace transforms of v a (f), i a (f), and ai(f), 
respectively. Substituting the value of I- d (s) from Eq. (8.30), Eq. (8.35) can be 
expressed as follows: 

^-[sL d + R d ]T m (s) + k(fl(s) = V a (s). (8.36) 

We also take the Laplace transform of Eq. (8.34) to derive 

[Js 2 + rs]d(s) = T m (s ), (8.37) 

where we have ignored the disturbance torque 7’ ( |(,v ), which will later be approx- 
imated as noise to the system’s input. Substituting 6(s ) = Q(s )/s, Eq. (8.37) is 
expressed as follows: 


T m (s) = [Js + r]f2(s). (8.38) 

Finally, substituting the value of 7 m (,v) from Eq. (8.38) into Eq. (8.35) yields 
[sL a + R a ] [/s + r]l7(i) + k m k f Q{s) — k m V d {s) 


or 


Q{s) 


V a {s) LJs 2 + [R a J + L a r]s + [R d r + k m k f ] 
The transfer function // (,v ) can therefore be expressed as follows: 
e(s) n(s) k m /jL. d 


(8.39) 


H(s) = 


V a (s) sV a (s) 3 


s 3 + 


R d J + L d r 

,2 + 

LJ 



R a r T k m kf 

lj 


H(s) = 


kL 


s 3 + 2 % n 0 ) n s- + cop 


(8.40) 


where 


k' - — £ - — 

m ~ t T ’ Sn ~ n 

J 1—j a Z(f)n 


R a r 

ZT + 7 


and co n = 


J R-df T k m k{ 
LJ 


From Eq. (8.40), we note that the system transfer function H{s) has a third- 
order characteristic equation with one pole at the origin (,v = 0) of the s-plane. 
The remaining two poles are located at 

Pi = y ;// Hii 1 and p 2 = ^n(Dn (D n y ,,// tj 2 1 . (8.41) 

As £„ and a>„ are positive, the two non-zero poles lie in the left half of the 
complex s-plane. Due to the zero pole, however, the system is a marginally 
stable system. 
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Impulse response Since 


1 


H(s ) = - x 


s s 2 + 2 % n co„s + a> 2 

the impulse response of the dc motor equals the integral of the impulse response 
h'(t), the inverse Laplace transform of H'(s). Since the form of II' is) is similar 
to the transfer function of the spring damping system, Eqs. (8.20) — (8.27) are 
used to derive the impulse response h(t) of the dc motor. Depending upon the 
value of f„, we consider three different cases. 

Case 1 (£„ = 1) As derived in Eq. (8.21), the inverse Laplace transform of 
H\s ) for = 1 is given by 

k' m ter m "'u(t) < L 

Taking the integral of h'(t) yields 


i- + 2 + <w 2 


h{t) = 


re-^'dr = -k'J — + -1 

(On COZ ■ 


= f k'je t = 


e -«„r + c for t > o (8 42) 


Case 2 (£„ > 1) Equation (8.24) derives the inverse Laplace transform of II' (s) 
for > 1 as follows: 


2 o). 


k m e -s.«w M (0 

v 7 ^ L J 


jfcL 


s 2 + 2%„(o n s + « 2 


The impulse response of the dc motor is given by 

h(t) = [ p-Hn<Ont\ _ -0) n 1 1 

2a> n Jg - 1 J L J 


2(Dn4i} 


dt 


=\- 

- 1 Li 




V — 1 r 


2(0 n \/ 'k 2 1 L ^ n (On T 1 ?/; \f^n ^ - 

+ C for t > 0. (8.43) 


Case 3 (£„ < 1) Equation (8.27) derives the inverse Laplace transform of //'(,v) 
for < 1 as follows: 


e w sin [« /l - | 2 , t 

'"V 1 - s„ L 


m(0 




5 2 + 2§„®„i + (O 2 


The impulse response of the dc motor is given by 

k 1 , 

hit ) = 


1 - 

k' e-Sn<0nt 


=f f e w sin ["V 1 - f 

Srj ^ 

[/ 1 - C0S 


df 


+ f/! sin ^ t 


C for f > 0. 


(8.44) 
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Fig. 8.9. Impulse response of 
the armature-controlled dc 
motor for k ^ = 1000 and 

0) n = 50. 



In Eqs. (8.42)-(8.44), C is the integration constant, which can be computed 
from the initial conditions. 

Figure 8.9 plots the impulse response of the armature-controlled dc motor for 
k m = 1000 and &>„ = 50. Three different values of £„ are chosen and the value 
of the integration constant C is set to 0.4. As is the case for the spring damping 
system, the impulse response is critically damped for = 1, underdamped 
for = 0.2, and overdamped for = 4. In the case of the underdamped 
system, the frequency of oscillations is given by a>„ = 50 radians/s, with the 
fundamental period given by 2jt/50, or 0.126 seconds. 


Block diagram To derive the feedback representation of the armature- 
controlled dc motor, Eq. (8.35) is expressed as follows: 

[sL d + R. d ] I d (s) = V a (s) - k f (2(s). (8.45) 

Substituting I- d (s) = T m (s)/k m , Eq. (8.35) is given by 

[sL a + R d ]T m (s) = k m [V, d (s) - k f 12(s)]. (8.46) 

Taking the Laplace transform of Eq. (8.32), we obtain 

T m (s)=[sJ + r]n(s) + T i . (8.47) 


Substituting Eq. (8.47) into Eq. (8.46), the relationship between the input volt- 
age V a (s) and the angular velocity Us) is given by 


l?(s) = 


1 


[Js + r] 


[L a s + R d 


[Va(s) - kfUs)] - T d . 


(8.48) 


Equation (8.48) is used to develop the block diagram representation for the 
transfer function: 


H'(s) 


U s ) 

Va00 


k’ 

[hn 

S 2 + 2 % n O) n S + CO 2 


which is shown in Fig. 8.10. In this case, the system has two poles, both are 
in the left-half of the s-plane. Therefore, the system is a stable system. The 
block diagram representation of the transfer function H(s) can be obtained by 
integrating a>(t), which in the Laplace domain is equivalent to multiplying kl(s ) 
by a factor of 1 /s. A block with the transfer function 1 /s can, therefore, be 
cascaded at the end of Fig. 8.10 to derive the feedback configuration for ll(s). 
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Fig. 8.10. Schematic models for 
the dc motor with transfer 
function H'(s). 
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8.4 Immune system in humans 


We now apply the Laplace transform to model a more natural system, such as 
the human immune system. The human immune system is non-linear but, with 
some assumptions, it can be modeled as a linear time-invariant (LTI) system. 
Below we provide the biological working of the human immune system, which 
is followed by an explanation of its linearized model. 

Human blood consists of a suspension of specialized cells in a liquid, referred 
to as plasma. In addition to the commonly known erythrocytes (red blood 
cells) and leukocytes (white blood cells), blood contains a variety of other 
cells, including lymphocytes. The lymphocytes are the main constituents of 
the immune system, which provides a natural defense against the attack of 
pathogenic microorganisms such as viruses, bacteria, fungi, and protista. These 
pathogenic microorganisms are referred to as antigens. When the lymphocytes 
come into contact with the foreign antigens, they yield antibodies and arrange 
the antibodies on their membrane. The antibody is a molecule that binds itself 
to antigens and destroys them in the process. When sufficient numbers of anti- 
bodies are produced, the destruction of the antigens occurs at a higher rate than 
their creation, resulting in the suppression of the disease or infection. Based on 
this simplified explanation of the human immune system, we now develop the 
system equations. 


8.4.1 Mathematical model 

The following notation is used to develop a mathematical model for the human 
immune system: 

g(t) = number of antigens entering the human body; 

a(t ) = number of antigens already existing within the human body; 

/(f) = number of active lymphocytes; 
p(t ) = number of plasma cells; 
b(t) = number of antibodies. 
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Number of antigens At any given time, the total number of antigens present 
in the human body depends on three factors: (i) external antigens entering 
the human body from outside; (ii) reproduced antigens produced within the 
human body by the already existing antigens; and (iii) destroyed antigens that 
are eradicated by the antibodies. The net change in the number of antigens is 
modeled by the following equation: 

^ = aa(t) - rjb(t) + g(f), (8.49) 

at 

where a denotes the reproduction rate at which the antigens are multiplying 
within the human body and ij is the destruction rate at which the antigens are 
being destroyed by the antibodies. 

Number of lymphocytes Assuming that the number of lymphocytes is pro- 
portional to the number of antigens, the number of lymphocytes present within 
the human body is given by 


lit ) = Pa(t), (8.50) 

where ft is the proportionality constant relating the number of lymphocytes to 
the number of antigens. The value of ft generally depends on many factors, 
including the health of the patient and external stimuli. In general, ft varies 
with time in a non-linear fashion. For simplicity, however, we can assume that 
P is a constant. 

Number of plasma cells The change in the number of plasma cells is pro- 
portional to the number of lymphocytes l(t). Typically, there is a delay of r 
seconds between the instant that the antigens are detected and the instant that 
the plasma cells are generated. Therefore, the number of plasma cells depends 
on l{t — r), where the proportionality constant is assumed to be unity. Also, a 
large portion of plasma cells die due to aging. The number of plasma cells at 
any time t can therefore be expressed as follows: 

^7 = Ht - r) - yp(t), (8.51) 

df 

where y denotes the rate at which the plasma cells die due to aging. 

Number of antibodies The number of antibodies depends on three factors: 
(i) new antibodies being generated by the human body (the rate of generation // 
of the new antibodies is proportional to the number of plasma cells in the human 
body); (ii) destroyed antibodies lost to the antigens (the rate of destruction a 
of such antibodies is proportional to the number of existing antigens); and 
(iii) dead antibodies lost to aging. We assume that the antibodies die at the rate 
of X because of aging. Combining the three factors, the number of antibodies 
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at any time t is given by 

d b 

— = fip(t) — aa(t) — Xb(t). (8.52) 

dr 


8.4.2 Transfer function 


Equations (8.49)-(8.52) describe the linearized model used to analyze the 
human immune system. To develop the transfer function, we take the Laplace 
transform of Eqs. (8.49)-(8.52). The resulting expressions can be expressed as 
follows: 


1 


number of antigens 
number of lymphocytes 

A(s)= - ~[G(s) - pBis)]- 

(s - a) 

L(s) = PA(s); 

(8.53) 

(8.54) 

number of antigens 

q T S 

P(s) = — — -L(s)\ 
(s + y) 

(8.55) 

number of antibodies 

B(s)= [ p.P(s ) orA(s)]. 

(8.56) 


(s + X) 


In Eqs. (8.53)— (8.56), variables A(s), G(.v), L(s), I’(s). and B (,v ) are, respec- 
tively, the Laplace transforms of the number of antigens a{t) present within the 
human body, the number of antigens g(t ) entering the human body, the number 
of lymphocytes /(f) within the blood, the total number of antigens p(t) within 
the human body, and the number of antibodies b(t ) in the blood. Assuming the 
number of antigens g(t ) entering the human body to be the input and the number 
of antibodies b(t) produced to be the output, the human immune system can be 
modeled by the schematic diagram shown in Fig. 8.11(a). Figure 8.1 1(b) is the 
simplified version of Fig. 8. 1 1(a), which yields the following transfer function 
for the human immune system: 

M(s) M/Je-” - a(s + y) 

T(s) = = . 

(1 + p M(s)) (s - a)(s + X)(s + y) + rilpfie zs - a(s + y)] 

(8.57) 


8.4.3 System simulations 

The simplified model of the human immune system is still a fairly complex 
system to be analyzed analytically. The characteristic equation of the human 
immune system is not a polynomial of s, therefore evaluation of its poles is 
difficult. In this section, we simulate the human immune system using the 
simulink toolbox available in Matlab . 

8.43.1 Simulation 1 


In simulink, a system is simulated using a block diagram where the subblocks 
represent different subsystems. Figure 8.12 shows the simulink representation of 
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Fig. 8.11. Schematic models for 
the immune response system. 

(a) Detailed model; 

(b) simplified model. 



(b) 


the human immune system shown in Fig. 8.11. We have assumed a hypothetical 
case with the values of the proportionality constants given by 

or = 0.1, £ = 0.5, y — 0.1, ii = 0.5, r = 0.2, X = 0.1, 
a =0.1, and rj = 0.5. 


Fig. 8.12. Simulink model for 
Simulation 1 modeling the 
immune response system of 
humans. 


The proportionality constants a, y, a, and X related to the antigens are deliber- 
ately kept smaller than the proportionality constants £, 77 , and /i related to the 
antibodies for quick recovery from the infection. The input signal g(t) modeling 
the number of antigens entering the human body is approximated by a pulse 
and is shown in Fig. 8.13(a). The duration of the pulse is 0.5 s, implying that 
the antigens keep entering the human body at a constant level for the first 0.5 s. 
The outputs a(t), p(t), and b(t) are monitored by the simulated scope available 
in simulink. The output of the scope is shown in Fig. 8.13(b), where we observe 
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t (s) t (s) 


(a) 


(b) 


Fig. 8.13. Results of Simulations 
1 and 2. (a) Number of antigens 
g(t) entering the human body, 
(b) Time evolution of the 
number of antigens off), plasma 
cells p(t), and antibodies b(t) in 
Simulation 1. (c) Same as (b) for 
Simulation 2. 
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that the number of antigens increases linearly for the initial duration of 0.5 s. 
Since the human body generates lymphocytes with a delay r, which is 0.2 s in 
our simulation, the number of plasma cells p(t) starts rising with a delay of 0.2 s. 
After 0.5 s, no external antigens enter the human body. However, new antigens 
are being reproduced by the already existing antigens present inside the human 
body. As a result, the number of antigens a{t) keeps rising, even after 0.5 s. 
After roughly 3 s, the respective strengths of lymphocytes and plasma cells is 
high enough to impact the overall population of the antigens. The number of 
antigens a(t ) starts decreasing after 3 s. After 5.3 s, all antigens in the body 
are destroyed. At this time, the body stops producing any further plasma cells. 
After this stage, the number of plasma cells p(t) starts decreasing, as some of 
these cells die naturally due to aging. As the number of plasma cells decreases, 
the number of antibodies b(t) also decreases such that after 10 s no antibodies 
are present in the simulation. 


8.4.3.2 Simulation 2 


Simulation 1 models successful eradication of the antigens. Let us now consider 
the other extreme, where the antigens are lethal such that the human immune 
system is unable to terminate the infection. The proportionality constants /3 and 
p related to the antibodies have lower values than those specified in Simulation 
1 . Also, the delay r between the instant when the antigens are detected to the 
instant when antibodies are produced is increased to 1 s. The simulated values 
of the constants are given by 

a = 0.1, /8 = 0.1, y=0.1, p = 0.3, r = 1, k = 0.1, cr = 0.1, 

and = 0.5. 
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As in Simulation 1, the input signal g(t) representing the number of antigens 
entering the human body is assumed to be a pulse of duration 0.5 s. The numbers 
of antigens a(t), plasma cells p{t), and antibodies b(t ) are monitored with the 
simulated scope available in simulink and are plotted in Fig. 8. 1 3(c). We observe 
that the number of antigens a(t) increases at an exponential rate. Although the 
number of plasma cells p(t), and consequently the number of antibodies b(t), 
also increases, it does so at a slower pace due to the small value of /I and large 
delay r. Since the number of antigens exceeds the number of plasma cells, the 
antibodies are destroyed by the antigens. This is shown by negative values for 
the number of antibodies b(t). In reality, the minimum number of antibodies is 
zero. The negative values are observed because of the unconstrained analytical 
model. We can make Simulation 2 more realistic by constraining the number 
of antigens, plasma cells, and antibodies to be greater than zero. 

In summary, Simulation 1 presents a scenario where the patient will survive, 
whereas Simulation 2 presents a scenario where the patient will die. Although 
this model presents a very simplistic view of a highly complex system, it is pos- 
sible to improve the model by using more accurate model parameters. Similar 
mathematical models can be used in several applications, such as population 
prediction, ecosystem analysis, and weather forecasting. 


8.5 Summary 


We have presented applications of signal processing in analog communica- 
tions, mechanical systems, electrical machines, and human immune systems. 
In particular, the CTFT and Laplace transform were used to analyze these 
systems. Section 8.1 introduced amplitude modulation (AM) and used the 
CTFT to analyze the frequency characteristics of AM-based communication 
systems. Both synchronous and asynchronous detection schemes for recon- 
structing the information-bearing signals were developed. Sections 8.2 and 8.3 
used the Laplace transform to analyze the spring damping system and armature- 
controlled dc motor. For the two applications, the transfer function and impulse 
response of the overall systems were derived. Section 8.4 used the Laplace 
transform to model the human immune system. An analytical model for the 
human immune system was developed and later analyzed using the simulink 
toolbox available in Matlab . 


Problems 


8.1 The infonnation signal given by 


x{t) = 3 sin(2^/if) + 2 co&(2it fit) 
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modulates the carrier signal c(t) — cos(2jr/ r f) with the AM signal s(t) 
given by Eq. (8.1). 

(a) Determine the value of the modulation index £ to ensure |s(f )| >0 for 
all t. 

(b) Determine the ratio of the power lost because of the transmission of 
the carrier in s(t ) versus the total power of s(t). 

(c) Sketch the spectrum of x(t ) and s(t) for fa = 10 kHz, fa = 20 kHz, 
and f c — 50 kHz. 

(d) Show how synchronous demodulation can be used to reconstruct x(t) 
from s(t). 

8.2 Repeat Problem 8.1 for the information signal 

x(t ) = sinc(5 x 10 3 f) 

if the fundamental frequency of the carrier is given by f c — 20 kHz. 

8.3 An AM station uses a modulation index k of 0.75. What fraction of the 
total power resides in the information signal? By repetition for different 
values of k within the range 0 < k < 1 , deduce whether low or high values 
of modulation index are better for improved efficiency. 

8.4 Synchronous demodulation requires both phase and frequency coherence 
for perfect reconstruction of the information signal. Assume that the infor- 
mation signal 

x(t) = 2 sin(2 or fat) 

is used to modulate the carrier c(t) — cos(2itf c t). However, the demod- 
ulating carrier has a frequency offset given by c(t ) = cos[27r/ c + A f)1). 
Determine the spectrum of the demodulated signal. Can the information 
signal be reconstructed in such situations? 

8.5 A special case of amplitude modulation, referred to as the quadrature ampli- 
tude modulation (QAM), modulates two information-bearing signals X\(t) 
and X 2 (f) simultaneously using two different carriers ci (f) = A \ cos(2itf c t ) 
and C 2 (f) = A 2 sin(2jrf c t). The QAM signal is given by 

s(t) = Ai[l + k\X\(t)] cos(2jrf c t ) + A 2 [l + £ 2 * 2 ( 0 ] sin(2jr/ c r), 

where k\ and £2 are the two modulation indexes used for modulating X\(t) 
and X 2 (t). Draw the block diagram of the demodulator that reconstructs 
X\(t) and *2(0 from the modulated signal. 

8.6 Assume the frictional coefficient r of the spring damping system, shown in 
Fig. 8.6, to equal zero. Determine the transfer function H(s) and impulse 
response h(t) for the modified model. Based on the location of the poles, 
comment on the stability of the spring damping system. 
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Fig. P8.ll. Block diagram 
representation of a phase-locked 
loop. 


K, 


K? 



8.7 By integrating the impulse response h(t) of the armature-controlled dc 
motor, derive Eq. (8.42) for £„ = 1. 

8.8 Assume that the inductance L a of the induction motor, shown in Fig. 8.8(b), 
is zero. Determine the transfer function // (,v ) and impulse response h(l) 
for the modified model. Based on the location of the poles, comment on 
the stability of the induction motor. 

8.9 Repeat Problem 8.7 for Eq. (8.43) with > 1 and Eq. (8.44) with £„ < 1. 

8.10 Based onEqs. (8.53)-(8.56), derive the expression for the transfer function 
H(s ) of the human immune system shown in Eq. (8.57). 

8.11 In order to achieve synchronization between the modulating and demod- 
ulating carriers, a special circuit referred to as a phase-locked loop (PLL) 
is commonly used in communications. The block diagram representing 
the PLL is shown in Fig. P8. 1 1 . 

Show that the transfer function of the PLL is given by 
PC?) _ K K sGis) 

<P{s) ~ 1 2 s + K 1 G(sY 

where K\ and Ki are gain constants and G(s) is the transfer function of 
a loop filter. Specify the condition under which the PLL acts as an ideal 
differentiator. In other words, derive the expression for G(s ) when the 
transfer function of the PLL equals Ks, with K being a constant. 

8.12 Repeat the simulink simulation for the human immune system for the 
following values of the proportionality constants: 

a — 0.3, /1 = 0.1, y = 0.25, /x = 0.6, r = 1, k = 0.1, 

a — 0.4, and rj — 0.2 

Sketch the time evolution of the antigens, plasma cells, and antibodies. 
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Discrete-time signals and systems 





CHAPTER 



Sampling and quantization 


Part II of the book covered techniques for the analysis of continuous-time (CT) 
signals and systems. In Part III, we consider the corresponding analysis tech- 
niques for discrete-time (DT) sequences and systems. A DT sequence may 
occur naturally. Examples are the one-dimensional (ID) hourly measurements 
x[k ] made with an electronic thermometer, or the two-dimensional (2D) image 
x[m, n] recorded with a digital camera, as illustrated earlier in Fig. 1.1. Alter- 
natively, a DT sequence may be derived from a CT signal by a process known as 
sampling. A widely used procedure for processing CT signals consists of trans- 
forming these signals into DT sequences by sampling, processing the resulting 
DT sequences with DT systems, and converting the DT outputs back into the 
CT domain. This concept of DT processing of CT signals is illustrated by the 
schematic diagram shown in Fig. 9.1. Here, the input CT signal x(t) is con- 
verted to a DT sequence x[k] by the sampling module, also referred to as the 
A/D converter. The DT sequence is then processed by the DT system module. 
Finally, the output y [A ] of the DT module is converted back into the CT domain 
by the reconstruction module. The reconstruction module is also referred to as 
the D/A converter. Although the intermediate waveforms, a | k ] and y[k], are 
DT sequences, the overall shaded block may be considered as a CT system 
since it accepts a CT signal x(t ) at its input and produces a CT output yit). If 
the internal working of the shaded block is hidden, one would interpret that the 
overall operation of Fig. 9.1 results from a CT system. 

In practice, a CT signal can either be processed by using a full CT setup, 
in which the individual modules are themselves CT systems (as explained in 
Chapters 3-8), or by using a CT-DT hybrid setup (as shown in Fig. 9.1). Both 
approaches have advantages and disadvantages. The primary advantage of CT 
signal processing is its higher speed as DT systems are not as fast as their 
counterparts in the CT domain due to limits on the sampling rate of the A/D 
converter and the clock rate of the processor used to implement the DT systems. 
In spite of its limitation in speed, there are important advantages with DT sig- 
nal processing, such as improved flexibility, self-calibration, and data-logging. 
Whereas CT systems have a limited performance range, DT systems are more 


393 




394 


Part III Discrete-time signals and systems 


Fig. 9.1. Processing CT signals 
using DT systems. 



flexible and can be reprogrammed such that the same hardware can be used in a 
variety of different applications. In addition, the characteristics of CT systems 
tend to vary with changes in the operating conditions and with age. The DT 
systems have no such problems as the digital hardware used to implement these 
systems does not drift with age or with changes in the operating conditions and, 
therefore, can be self-calibrated easily. Digital signals, obtained by quantizing 
DT sequences, are less sensitive to noise and interference than analog signals 
and are widely used in communication systems. Finally, the data available from 
the DT systems can be stored in a digital server so that the performance of the 
system can be monitored over a long period of time. In summary, the advan- 
tages of the DT system outweigh their limitations in most applications. Until 
the late 1980s, most signal processing applications were implemented with CT 
systems constructed with analog components such as resistors, capacitors, and 
operational amplifiers. With the recent availability of cheap digital hardware, 
it is a common practice now to perform signal processing in the DT domain 
based on the hybrid setup shown in Fig. 9. 1 . 

Although, a CT-DT hybrid setup similar to Fig. 9. 1 is advantageous in many 
applications, care should be taken during the design stage. For example, during 
the sampling process some loss of information is generally inevitable. Conse- 
quently, if the system is not designed properly, the performance of a CT-DT 
hybrid setup may degrade significantly as compared with a CT setup. In this 
chapter, we focus on the analysis of the sampling process and the converse 
step of reconstructing a CT signal from its DT version. In addition, we also 
analyze the process of quantization for converting an analog signal to a digi- 
tal signal. Both time-domain and frequency-domain analyses are used where 
appropriate. 

The organization of Chapter 9 is as follows. Section 9.1 introduces the 
impulse-train sampling process and derives a necessary condition, referred to as 
the sampling theorem, under which a CT signal can be perfectly reconstructed 
from its sampled DT version. We observe that violating the sampling theorem 
leads to distortion or aliasing in the frequency domain. Section 9.2 introduces 
the practical implementations for impulse-train sampling. These implementa- 
tions are referred to as pulse-train sampling and zero-order hold. 

In Section 9.3, we introduce another discretization process called quantiza- 
tion, which, in conjunction with sampling, converts a CT signal into a digital 
signal. In Section 9.4, we present an application of sampling and quantization 
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used in recording music on a compact disc (CD). Finally, Section 9.5 con- 
cludes our discussion with a summary of the key concepts introduced in the 
chapter. 


9.1 Ideal impulse-train sampling 


In this section, we consider sampling of a CT signal x{t) with a bounded CTFT 
X (a>) such that 


X(a>) — 0 for \co\ > 2 nft. 


(9.1) 


A CT signal x(t) satisfying Eq. (9.1) is referred to as a baseband signal, which 
is band-limited to 2tt ft radians/s or ft Hz. In the following discussion, we prove 
that a baseband signal x(t) can be transformed into a DT sequence x[k] with 
no loss of information if the sampling interval T s satisfies the criterion that 
T s < 1/2/1. 

To derive the DT version of the baseband signal x(t), we multiply x(t ) by an 
impulse train: 

OO 

s(t)= <5(1 — kT s ), (9.2) 

k — — oo 


where T s denotes the separation between two consecutive impulses and is called 
the sampling interval. Another related parameter is the sampling rate o> s , with 
units of radians/s, which is defined as follows: 


co s 


2jt 

tT' 


(9.3) 


Mathematically, the resulting sampled signal, x s (t) = x(t) ■ s(t), is given by 


OO OO 

x s (t) = x(t) Y S(t - kT s ) = Y ~ kT s)- (9-4) 

k— — oo k=—oo 


Figure 9.2 illustrates the time-domain representation of the process of the 
impulse-train sampling. Figure 9.2(a) shows the time-varying waveform repre- 
senting the baseband signal x(t). In Figs. 9.2(b) and (c), we plot the sampled 
signal xjt) for two different values of the sampling interval. In Fig. 9.2(b), the 
sampling interval T s = T and the sampled signal xjt) provides a fairly good 
approximation of x(t). In Fig. 9.2(c), the sampling interval T s is increased to 
2 T . With T s set to a larger value, the separation between the adjacent samples 
in x s (t) increases. Compared to Fig. 9.2(b), the sampled signal in Fig. 9.2(c) 
provides a coarser representation of x(t ). The choice of 7/ therefore determines 
how accurately the sampled signal x s (t) represents the original CT signal x(t). 
To determine the optimal value of 7), we consider the effect of sampling in the 
frequency domain. 
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Fig. 9.2. Time-domain 
illustration of sampling as a 
product of the band-limited 
signal and an impulse train. 

(a) Original signal ^(f); 

(b) sampled signal x s (t) with 
sampling interval T s = T ; 

(c) sampled signal x s (t) with 
sampling interval T s = 2T . 
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(c) 


Calculating the CTFT of Eq. (9.4), the CTFT X s (tv) of the sampled signal 
x s (t ) is given by 


X s (ro) = Sf 


1 

2n 


°o ) | I » 1 

(o J2 = — F{jr(f)}*3) J2 S(t ~ kT ^ 1 

k=- oo J 171 [ k——oo J 

2 Jr ^ / 2mTt\~\ 1 ^ / 2mn\ 

X(»)»- £ s r~^rl =T T. 

s m=—o o ^ s / s mi— _ oo \ s / 


(9.5) 


where * denotes the CT convolution operator. In deriving Eq. (9.5), we used 
the following CTFT pair: 


Fig. 9.3. Frequency-domain 
illustration of the impulse-train 
sampling, (a) Spectrum X(ai) of 
the original signal x(t); 

(b) spectrum X s (co) of the 
sampled signal x s (f) with 
sampling rate ai s > An p-, (c) 
spectrum X s (w) of the sampled 
signal x s {t) with sampling rate 
w s < A nfi. 


oo 

S(t - kT s ) 



based on entry (19) of Table 5.2. Equation (9.5) implies that the spectrum X s (co) 
of the sampled signal x s (t) is a periodic extension, consisting of the shifted 
replicas of the spectrum X(a>) of the original baseband signal x(t). Figure 9.3 
illustrates the frequency-domain interpretation of Eq. (9.5). The spectrum of the 
original signal x(t) is assumed to be an arbitrary trapezoidal waveform and is 
shown in Fig. 9.3(a). The spectrum X s (o>) of the sampled signal xjt) is plotted 
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in Figs. 9.3(c) and (d) for the following two cases: 

case I co s > 4 itf ; 

case II a> s < 4jt/6. 

When the sampling rate &> s > 4tt ft, no overlap exists between consecutive repli- 
cas in Xfw). However, as the sampling rate a> s is decreased such that co s < 
adjacent replicas overlap with each other. The overlapping of replicas is referred 
to as aliasing, which distorts the spectrum of the original baseband signal x(t) 
such that x(t) cannot be reconstructed from its samples. To prevent aliasing, the 
sampling rate co s > 4itf. This condition is referred to as the sampling theorem 
and is stated in the following 

Sampling theorem A baseband signal x(t), band-limited to 2nft radians! s, can 
be reconstructed accurately from its samples x(kT) if the sampling rate co s , in 
radians/s, satisfies the following condition: 

co s > 4jt/3. (9.6a) 

Alternatively, the sampling theorem may be expressed in terms of the sampling 
rate f s — (o s /2n in samples! s, or the sampling interval T s . To prevent aliasing, 

sampling rate (samples/s) f s >2/1; (9.6b) 

or 

sampling interval T s < 1/2/1. (9.6c) 

The minimum sampling rate / s (Hz) required for perfect reconstruction of the 
original band-limited signal is referred to as the Nyquist rate. 

The sampling theorem is applicable for baseband signals, where the sig- 
nal contains low-frequency components within the range 0 — fi Hz. In some 
applications, such as communications, we come across bandpass signals that 
also contain a band of frequencies, but the occupied frequency range lies 
within the band fi — f>\ Hz with f- 0. In these cases, although the max- 
imum frequency of /It Hz implies the Nyquist sampling rate of H z it 
is possible to achieve perfect reconstruction with a lower sampling rate (see 
Problem 9.8). 


T The sampling theorem was known in various forms in the mathematics literature before its 
application in signal processing, which started much later, in the 1950s. Several people 
developed independently or contributed towards its development. Notable contributions, 
however, were made by E. T. Whittaker (1873-1956), Hairy Nyquist (1889-1976), Karl 
Kupfmiiller (1897-1977), V. A. Kotelnikov (1908-2005), Claude Shannon (1916-2001), and 
I. Someya. 
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9.1.1 Reconstruction of a band-limited signal from its samples 

Figure 9.3(b) illustrates that the CTFT X s (o>) of the sampled signal xjt) is a 
periodic extension of the CTFT of the original signal x(t). By eliminating the 
replicas in X s (oj), we should be able to reconstruct x(t). This is accomplished 
by applying the sampled signal x s (f ) to the input of an ideal lowpass filter (LPF) 
with the following transfer function: 


H(w) = 


T s 

0 


M < co s /2 

elsewhere. 


(9.7) 


The CTFT Y (co) of the output y(t ) of the LPF is given by Y ( co ) = X s (co)H(co), 
and therefore all shifted replicas at frequencies co > co s /2 are eliminated. All 
frequency components within the pass band co < co s /2 of the LPF are amplified 
by a factor of T s to compensate for the attenuation of \/T s introduced during 
sampling. The process of reconstructing x(t) from its samples in the frequency 
domain is illustrated in Fig. 9.4. We now proceed to analyze the reconstruction 
process in the time domain. 

According to the convolution property, multiplication in the frequency 
domain transforms to convolution in the time domain. The output y{t) of 
the lowpass filter is therefore the convolution of its impulse response h(t) 
with the sampled signal x s (t). Based on entry (17) of Table 5.2, the impulse 
response of an ideal lowpass filter with the transfer function given in Eq. (9.7) is 
given by 




(9.8) 


Fig. 9.4. Reconstruction of the 
original baseband signal x(t) by 
ideal lowpass filtering. 

(a) Spectrum of the sampled 
signal x s (t): (b) transfer function 
H(cl>) of the lowpass filter; 

(c) spectrum of the 
reconstructed signal x(t). 


Convolving the impulse response h(t) with the sampled signal, x s (t) = 

OO 

x(kT s )8(t — kT s ) yields 

k= — oo 


y(t) — sine 



OO 

* x(kT s )8(t - kT s ), 

k— — oo 


(9.9) 


which reduces to 


OO 

v (o = x(kTs) 

k=—o o 


sine 



* 8(t - kT s ) 


(9.10) 



Y(co) 



-2jij3 0 2 7tp 
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Fig. 9.5. Reconstruction of the 
band-limited signal in the time 
domain, (a) Sampled signal 
x s (t); (b) impulse response h(t) 
of the lowpass filter; 

(c) reconstructed signal x(t) 
obtained by convolving x s (t) 
with h(t). 


or 


OO 

y(t) = x(kT s ) 

k = — OO 


sine 


- kT s ) ^ 


(9.11) 


Equation (9.11) implies that the original signal x(t) is reconstructed by adding 
a series of time-shifted sine functions, whose amplitudes are scaled according 
to the values of the samples at the center location of the sine functions. The 
sine functions in Eq. (9.1 1) are called the interpolating functions and the over- 
all process is referred to as the band-limited interpolation. The time-domain 
interpretation of the reconstruction of the original band-limited signal x(t) is 
illustrated in Fig. 9.5. At t — kT s , only the k\h sine function, with amplitude 
x(kT s ), is non-zero. The remaining sine functions are all zero. The value of the 
reconstructed signal at t = kT s is therefore given by x(kT s ). In other words, 
the values of the reconstructed signal at the sampling instants are given by the 
respective samples. The values in between two samples are interpolated using 
a linear combination of the time-shifted sine functions. 


Example 9.1 

Consider the following sinusoidal signal with the fundamental frequency /o of 
4 kHz: 


g(t) — 5cos(27r/oO = 5cos(8000 itt). 


(i) The sinusoidal signal is sampled at a sampling rate f s of 6000 samples/s 
and reconstructed with an ideal LPF with the following transfer function: 


f-k(oj) 


1/6000 M< 6000tt 
0 elsewhere. 


Determine the reconstructed signal. 
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(ii) Repeat (i) for a sampling rate f s of 12 000 samples/s and an ideal LPF with 
the following transfer function: 


H 2 (co) = 


1/12 000 
0 


M < 12 000:r 
elsewhere. 


Solution 

(i) The CTFT G(co) of the sinusoidal signal g(t) is given by 

G(co) = 5iv [8(a) - 8000tt) + 8(a) + 8000jt)]. 

Using Eq. (9.4), the CTFT G s (&>) of the sampled signal with a sampling rate 
a ) s = 27r(6000) radians/s ( T s = 1/6000 s) is expressed as follows: 

OO OO 

G s (co) — 6000 G(® - 2tt/m( 6000)) = 6000 ^ G(tw - 12 OOOwjt). 


Substituting the value of G(&>) in the above expression yields 


G s (co) = 6000 57r[5(tt> - 8000 jt - 12000;?i7r) 


= 6000(5jt) 


+ 8(co + 800071 — 12 000m7r)] 


■+8(co+ 160007T) + 8(a) + 32000jt) 


m =— 2 

+ 8(a> + 4000jt) + 8(a> + 20 0007r) 


-l 


+ 8(a) - 8000?r) + 8(a) + 8000tt) + 8(a - 20 000tt) + 8(a> - 4000;r) 


n = 0 


+ i5(a) — 320007r) + 8(a> — 16000jt) + --- 


n = 2 


When the sampled signal is passed through the ideal LPF with transfer func- 
tion H\(a>), all frequency components o> > 60007 r radians/s) are eliminated 
from the output. The CTFT Y(a)) of the output y(t) of the LPF is given 
by 

Y(a)) = Hi(o))G s (a)) = -J— • 6000(57r)[5(« + 4000 jt) + 8(0 - 4000jt)]. 


Calculating the inverse CTFT, the reconstructed signal is given by y(t) = 
5 cos(40007rt). 
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Fig. 9.6. Sampling and 
reconstruction of a sinusoidal 
signal g(t) = 5 cos(8000jrf) at 
a sampling rate of 
6000 samples/s. CTFTs of: 

(a) the sinusoidal signal g(t); 

(b) the impulse train s(t); (c) the 
sampled signal g s (f); 

and (d) the signal reconstructed 
with an ideal LPF H\(co) with a 
cut-off frequency of 
6000;r radians/s. 
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The graphical representation of the sampling and reconstruction of the sinu- 
soidal signal in the frequency domain is illustrated in Fig. 9.6. The CTFTs of 
the sinusoidal signal g(t) and the impulse train s(t) are plotted, respectively, 
in Fig. 9.6(a) and Fig. 9.6(b). Since the CTFT S(co) of s(t) consists of several 
impulses, the CTFT G s (&>) of the sampled signal g s (t) is obtained by convolving 
the CTFT G(a> ) of the sinusoidal signal g(t) separately with each impulse in 
G s (&>) and then applying the principle of superposition. To emphasize the results 
of individual convolutions, a different pattern is used in Fig. 9.6(b) for each 
impulse in S(a>). For example, the impulse S(a>) located at origin in S(a> ) is 
shown in Fig. 9.6(b) by a solid line. Convolving G(a>) with S(a>) results in two 
impulses located at co — ±8000tt, which are shown in Fig. 9.6(c) by solid lines. 
Similarly for the other impulses in S(o>). 

The output y(t) is obtained by applying G s (co) to the input of an ideal LPF 
with a cut-off frequency of 60007T radians/s. Clearly, only the two impulses at 
a — ± 4000jt, corresponding to the sinusoidal signal cos(40007rf), lie within 
the pass band of the lowpass filter. The remaining impulses are eliminated from 
the output. This results in an output, y(t ) = cos(40007rr), which is different 
from the original signal. 

(ii) The CTFT G s (o>) of the sampled signal with a> s — 2jt(l2 000) radians/s 
(T s = 1/12 000 s) is given by 


OO 

G s (ft>) = 12 000 G(co — 2nm(l2000)) 

m=—oo 

OO 

= 12000 G(m-24000mjt). 

m=—oo 
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Substituting the value of the CTFT G(«) = 5jt[S(« — 8000jt) 4- <5(u> 4- 
8000jt)] in the above equation, we obtain 


G s (co) = 12000 5jt[<$(<w - 8000jt - 24000mjr) 

m =— oo 

+ 8(a> + 8000jt — 24 OOOotjt)] 


= 12000(5jt) 


4- 8{co -f 40 OOOjt ) -f 4 ( co 4- 56 OOOjt ) 


m =— 2 

+ 8(a> + 16 OOOjt) 4- 8(a> + 32 OOOjt) 


-l 


+ 8{ca - 8000jt) + <5(w + 8000 jt) 4- 8(w - 32 000 it) + 8(o - 16 OOOjt) 


+ 8(co - 56 OOOjt) 4- 8{o) - 40 OOOjt) + • • • 

' 

m = 2 


To reconstruct the original sinusoidal signal, the sampled signal is passed 
through an ideal LPF Hiiw). The frequency components outside the pass-band 
range \co\ < 12 OOOjt radians/s are eliminated from the ouput. The CTFT Y (co) 
of the output y(t ) of the LPF is therefore given by 


TO) = 5jr[<$((w 4- 8000 jt) 4- S(w - 8000jt)], 


which results in the reconstructed signal 

y(t) = 5 cos(8000jrf). 

The graphical interpretation of the aforementioned sampling and reconstruction 
process is illustrated in Fig. 9.7. 

As the signal g(t) is a sinusoidal signal with frequency 4 kHz, the Nyquist 
sampling rate is 8 kHz. In part (i), the sampling rate (6 kHz) is lower than the 
Nyquist rate, and consequently the reconstructed signal is different from the 
original signal due to the aliasing effect. In part (ii), the sampling rate is higher 
than the Nyquist rate, and as a result the original sinusoidal signal is accurately 
reconstructed. 


9.1.2 Aliasing in sampled sinusoidal signals 

As demonstrated in Example 9.1, undersampling of a baseband signal at a 
sampling rate less than the Nyquist rate leads to aliasing. Under such conditions, 
perfect reconstruction of the baseband signal is not possible from its samples. 
In this section, we consider undersampling of a sinusoidal signal 

x{t) = cos(2jt/oO 

with a fundamental frequency of /o Hz. The sampling rate / s , in samples/s, 
is assumed to be less than the Nyquist rate of 2/o, i.e. / s < 2 /q. We show 
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Fig. 9.7. Sampling and 
reconstruction of a sinusoidal 
signal g(t) = 5 cos(80 007rf) at 
a sampling rate of 
12 000 samples/s. CTFTs of: 

(a) the sinusoidal signal g(t); 

(b) the impulse train s(t); 

(c) the sampled signal g s {t); and 

(d) the signal reconstructed with 
an ideal LPF H 2 (io) with a cut-off 
frequency of 12 000ir radians/s. 


that the reconstructed signal is sinusoidal but with a different fundamental 
frequency. 

Using Eq. (9.4), the CTFT X s (a>) of the sampled sinusoidal signal x s (t) is 
given by 

OO 

X s (co)=f s X(co-2mnf t ). (9.12) 

m=—oo 

InEq. (9.12), we substitute the CTFT, A(cw) = 7r[<5(®-2:r/o) + <5(&> + 27r/o)], 
of the sinusoidal signal x(t). The resulting expression is as follows: 


X s (a)) = 7Tf s ^ 8(co + 2jt(f 0 - mfj) + tt/ s ^ 8(a) - 2tt(/ 0 + kf s )). 

m=—oo k— — oo 

(9.13) 

To reconstruct x(t), the sampled signal x s (t ) is filtered with an ideal LPF with 
transfer function 


H(co) = 


T s 

0 


M < nf s 
elsewhere. 


(9.14) 


Within the pass band \a)\ < tt f s of the LPF, the input frequency components are 
amplified by a factor of 7 S or 1 / f s . All frequency components within the stop 
band \a>\ > i r/ s are eliminated from the reconstructed signal y(t). In addition, 
the CT FT of the reconstructed signal y(t ) satisfies the following properties. 


(1) The CTFT Y (a>) consists of impulses located at frequencies co — —2n(fo — 
mf s ) and a) = 2^(/o + kf s ), where m and k are integers such that |(/o — 
m fs)\ < / s /2and |(/q + kf s )\ < / s /2. Since the two conditions are satisfied 
only for/?; = —k. the locations of the impulses are given by co = ±2jt(/o — 

mf s ). 

(2) If |(/o - mfs) | < / s /2, then |(/ 0 - (m + 1)/,)| > /,/ 2 and |(/ 0 - (m - 
l)/ s )| > /s/2. Combined with (1), this implies that only two impulses at 
co = ±2^(/o — mfs) will be present in Y (co). 

(3) Each impulse in Y (co) will have a magnitude (enclosed area) of j r. 
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Based on properties (l)-(3) listed above, the spectrum of the reconstructed 
signal is given by 

Y(a) = 7T [S(o> + 2 tt(/ 0 - m/.)) + 8(to - 2n(f 0 - mf s ))]. (9.15) 

Calculating the inverse CTFT of Eq. (9.15) leads to the following sinusoidal 
signal: 


y(t) = cos(2jt(/o - mf s )t), (9.16) 

where m is an integer such that |(/o — mf s ) \ < f s / 2. 

Lemma 9.1 If a sinusoidal signal x(t) = cos(27r/o?) is undersampled such that 
the sampling rate / s < 2/o, then the signal reconstructed with an ideal LPF, 
with pass band \w\ < n f s , is another sinusoidal signal 

y{t) = cos(2jr(/o - mf s )t), 

where m is a positive integer satisfying the condition |(/o — mf s )\ < f s /2. 

In Example 9. 1 (i), for example, the fundamental frequency /o = 4000 Hz and 
the sampling rate / s = 6000 samples/s is less than the Nyquist rate. Selecting 
m = 1, the reconstructed signal y(t) is given by 

y(?) = cos(2^-(/o — mf s )t ) = cos(2jt( 4000 — 6000)?) = cos(40007rr). 

The result obtained from Lemma 9. 1 is in agreement with the expression derived 
in Example 9.1(i). 

Example 9.2 

A signal generator produces a sinusoidal tone x(t) = cos(2jt/o?) with funda- 
mental frequency /o between 1 Hz and 1000 kHz. The signal is sampled with a 
sampling rate f s = 6000 samples/s and is reconstructed using an ideal LPF with 
a cut-off frequency a> c = = 60007T radians/s. Determine the reconstructed 

signal for / 0 = 500 Hz, 2.5 kHz, 2.8 kHz, 3.2 kHz, 3.5 kHz, 7 kHz, 10 kHz, 
20 kHz, and 1000 kHz. 

Solution 

Table 9.1 lists the reconstructed signals obtained by applying Lemma 9.1. The 
sampling frequency / s in the top three entries of Table 9.1 satisfies the sampling 
theorem. Therefore, the original signal is reconstructed without any distortion. 
In the remaining entries, the sampling theorem is violated. Lemma 9.1 is used 
to determine the fundamental frequency of the reconstructed sinusoidal sig- 
nal, which is different from that of the original signal due to aliasing. The 
reconstructed signals are tabulated in entries (4)-(9) of Table 9. 1 . An inter- 
esting observation is that the reconstructed signals for the sinusoidal wave- 
forms x{t ) = cos(5 6 007T?) and x(t) = cos(6400t rf), listed in entries (3)— (4) 
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Table 9.1. Signals reconstructed from samples of a sinusoidal tone x ( t ) = cos( 27 t f 0 t) for different values of the 
fundamental frequency f 0 ; the sampling frequency f s is kept constant at 6000 samples/s 



Funadmental 
frequency (/o) 

Original 

signal 

K/o - m/,)| < /s/2 

Reconstructed 

signal 

Comments 

(1) 

500 Hz 

cos(10007rt) 

fs > 2/o 

cos(10007r?) 

no aliasing 

(2) 

2.5 kHz 

cos(50007r?) 

fs > 2/o 

cos(50007r?) 

no aliasing 

(3) 

2.8 kHz 

cos(56007T?) 

fs > 2/o 

cos(56007T?) 

no aliasing 

(4) 

3.2 kHz 

cos(64007T?) 

|3200 - 1 x 6000| 

cos(56007T?) 

aliasing 

(5) 

3.5 kHz 

cos(70007rt) 

|3500- 1 x 6000| 

cos(50007tO 

aliasing 

(6) 

7 kHz 

cos(14000jrf) 

|7000 - 1 x 6000| 

cos(20007rt) 

aliasing 

(7) 

10 kHz 

cos(20000jr t) 

1 10000 - 2 x 6000| 

cos(40007tO 

aliasing 

(8) 

20 kHz 

cos(400007rf) 

120000 - 3 x 6000| 

cos(40007T?) 

aliasing 

(9) 

1000 kHz 

cos(2 x 10 6 jr?) 

|10 6 - 167 x 6000| 

cos(40007T?) 

aliasing 


of Table 9.1, are identical. Similarly, the reconstructed signals for the sinu- 
soidal waveforms x(t) = cos(50(Xbrf) and x(t) — cos(700Cbrr), listed in entries 
(2) and (5) of Table 9.1, are also identical. Finally, the reconstructed signals 
for the sinusoidal waveforms x(t) = cos(20000jrr), x(t) = cos(40 0007rr), and 
x(t) = cos(2 x 10 6 7 rf), listed in entries (7)— (9) of Table 9.1, are the same. The 
identical waveforms are the consequences of aliasing. 


9.2 Practical approaches to sampling 


Section 9. 1 introduced the impulse-train sampling used to derive the DT version 
of a band-limited CT signal. In practice, impulses are difficult to generate and 
are often approximated by narrow rectangular pulses. The resulting approach 
is referred to as pulse-train sampling, which is discussed in Section 9.2.1. A 
second practical implementation, referred to as the zero-order hold, is discussed 
in Section 9.2.2. 


9.2.1 Pulse-train sampling 

In pulse-train sampling, the impulse train s(t ) is approximated by a rectangular 
pulse train of the form 


OO 

>-(o= p^~ kT ^ 

k— — OO 


OO 

^ S(t — kT s ) , 

k=—c o 


(9.17) 


where p\(t) represents a rectangular pulse of duration r <$; T s , which is given 
by 

PiiO = rect 
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Fig. 9.8. Time-domain 
illustration of the pulse-train 
sampling of a CT signal. 

(a) Original signal x(C); (b) pulse 
train r(f); (c) sampled signal 
*s(0 = x(t)r(t). 
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As in impulse-train sampling, the sampled signal xjt) is obtained by multiply- 
ing the reference signal x(t) by r(t) such that 


x s (t) = x(t)r(t) = x(t) 


OO 

pi(o* y S(t - kT ^ ■ 

k— — oo 


(9.18) 


Based on Eq. (9.18), the time-domain representation of the process of pulse- 
train sampling is shown in Fig. 9.8. The sampled signal, shown in Fig. 9.8(c), 
consists of several pulses of duration r . The magnitude of the rectangular pulses 
in x s (t) follows the reference signal x(t) within the duration of the pulses. 

To analyze the process in the frequency domain, we consider the CTFS 
expansion of the periodic pulse train. The exponential CTFS representation of 
/•(f) is given by(see Example 9.14) 


OO 

r(t)= D nZ >n< ’ ht with D n 

YI——OQ 



(9.19) 


where co s is the sampling rate in radians/s and is given by co s = 2 tt/ s = 2tt/T s . 
the CTFT of r(t) is given by 


OO 

R(a>) = 2n D n S(co — na) s ) with 

n = — oo 


D„ = 


CO s X 

sine 

2 7T 


nco s r 

2tz 


(9.20) 


Based on Eq. (9.18), the CTFT X s (a) ) of sampled signal x s (t) is given by 

1 

X s (a>) = — X(co) * R{co). (9.21a) 

2it 

Substituting the value of R{m) from Eq. (9.20) yields 


X s (co) = — X(co) * R(a>) = Y D„X(fl> — na> s ). 
9.7 T ^ ' 


(9.21b) 


407 


9 Sampling and quantization 


Fig. 9.9. Frequency-domain 
illustration of the pulse-train 
sampling of a CT signal. 
Spectrum of (a) the original 
signal x(t); (b) the pulse train 
r(f); (c) the sampled signal 
x s (t) =x(t)r(t). 
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Based on Eq. (9.21b), Fig. 9.9 illustrates the frequency-domain interpretation 
of the pulse-train sampling. The spectrum X(cd ) of the original signal x(t) is 
shown in Fig. 9.9(a), while the spectrum R(u > ) of the pulse train r(t) is shown 
in Fig. 9.9(b). The spectrum X s (oj) of the sampled signal xjt) is obtained 
by convolving X(co) with R(a>). As shown in Fig. 9.9(c), X s (oj) consists of 
several shifted replicas of X(a>) attenuated with a factor of D„. Compared to 
the impulse-train sampling, the spectra of the two sampled signals are identical 
except for a varying attenuation factor of D n introduced by the pulse-train 
sampling. 

Reconstruction of the original signal x(t ) from the pulse-train sampled signal 
x s (t ) is achieved by filtering x s (t) with an ideal LPF having a cut-off frequency 
a> c = co s /2 and a gain of I / D (t in the pass band. The FPF eliminates all shifted 
replicas present at frequencies |cw| > ox/2. This leaves a single replica at o> = 0, 
which is the same as the CTFT of the original signal. For perfect reconstruc- 
tion, pulse-train sampling should not introduce any aliasing. To prevent alias- 
ing between different replicas, the sampling rate f s must satisfy the sampling 
theorem, i.e. co s = 2 7tf s > Anfi. 


9.2.2 Zero-order hold 


A second practical implementation of sampling is achieved by the sample-and- 
hold circuit, which samples the band-limited input signal x(t) at discrete time 
( t = k'l\) and maintains the sampled value for the next 7’ s seconds. To pre- 
vent aliasing, the sampling interval T s must satisfy the sampling theorem. This 
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Fig. 9.10. Time-domain 
illustration of the zero-order 
hold operation for a CT signal. 

(a) Original signal x(C); 

(b) zero-order hold output x s (f). 



(a) 


(b) 


zero-order hold operation is illustrated in Fig. 9. 10. Unlike the pulse-train sam- 
pling, the amplitude of the sampled signal is maintained constant for T s seconds 
until the next sample is taken. 

For mathematical analysis, the zero-order hold operation can be modeled by 
the following expression: 

OO 

x s (t) = x (kT s )p 2 (t - kT s ) (9.22a) 

k = — oo 


or 


oo 

*s(0 = pi(t) * ^2 x(kT s )8(t - kT s ) = p 2 (t ) * 

k = — oo 


oo 

x(t) ^2 8(t - kT s ) , 

k — — oo 

(9.22b) 


where p 2 (t) represents a rectangular pulse given by 

ft -0.5T S \ 

p 2 (t) — recti - -J . (9.23) 

Equation (9.22b) models the zero-hold operation and is different from Eq. (9.18) 
in two ways. First, the duration of the pulse p 2 (t) in Eq. (9.22b) is the same as 
the sampling interval T s , whereas the duration of the pulse p\{t) is much smaller 
than T s in pulse-train sampling. Secondly, the order of operation in the sampled 
signal x s (t) is different from that used in the corresponding sampled signal in 
pulse-train sampling. In Eq. (9.22b), the sampled signal x s (t) is obtained by 
convolving p 2 (t) with a periodic impulse train, which is scaled by the values 
of the reference signal at the location of the impulse functions. In Eq. (9.18), 
on the other hand, x s (t) is obtained by multiplying the original signal directly 
by the periodic pulse train r(t). 

The CTFT of Eq. (9.22b) is given by 


X s (a>) = P 2 (co) ■ -L 

2 7T 


2tc 


* — £ 5 « - — 


2kic 


(9.24) 


k — — oo 

where P 2 (a>) denotes the CTFT of the rectangular pulse p 2 (t). Based on entry 
(16) of Table 5.2, the CTFT of p 2 {t) is given by the following transform pair: 

't — 0.5 T s \ CTFT 


rect 


T, sine 


/ a)T s 
\2n 


-j 0.5 coT s 
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Fig. 9.11. Frequency-domain 
illustration of the zero-order 
hold operation for a CT signal. 
CTFTs of the: (a) original signal 
x(t); (b) periodic replicas; and 
(c) the sampled signal x s (t). 
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Substituting the value of P 2 U 0 ), Eq. (9.23) can be expressed as follows: 


X s (co) 


_ p -j0.5 coT 5 


( coT s 




k=—oo 


2kjr 




(9.25) 


Based on Eq. (9.25), Fig. 9.11 illustrates the frequency-domain interpretation 
of the zero-hold operation. The spectrum X s (co) of the sampled signal is shown 
in Fig. 9. 1 1(c), which contains scaled replicas of the CTFT of the original base- 
band signal. Unlike the pulse-train sampling, some distortion in the amplitude 
is introduced in the central replica located at co = 0. This distortion can be 
minimized by increasing the width of the main lobe of the sine function in Eq. 
(9.25). Since the width of the main lobe is given by 2tt/T s , it is equivalent to 
reducing the sampling interval T s . 

To recover the original CT signal, the sampled signal is filtered with an 
LPF having a cut-off frequency a> c = co s / 2. Due to the amplitude distortion 
introduced in the central replica, ideal lowpass filtering recovers an approximate 
version of the original CT signal. For perfect reconstruction, the filter with the 
transfer function given by 


H(co) = 


sinc(coT s /2jt ) 

0 


M < co s /2 

elsewhere 


(9.26) 
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Fig. 9.12. Input-output 
relationship of an L -level 
quantizer used to discretize the 
sample values x[kT s ] of a DT 
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is used. The above filter is referred to as the compensation, or anti-imaging, 
filter. Filtering X s (o>) with the anti-imaging filter introduces a linear phase —coT s 
corresponding to the exponential term exp(— jwr s ). Inclusion of a linear phase 
in the frequency domain is equivalent to a delay in the time domain and is 
therefore harmless and not considered as a distortion. 

9.3 Quantization 


The process of sampling, discussed in Sections 9. 1 and 9.2, converts a CT signal 
x(t) into a DT sequence x[k], with each sample representing the amplitude of 
the CT signal x(t) at a particular instant t = kl\. The amplitude x[kT s \ of a 
sample in x[k\ can still have an infinite number of possible values. To produce 
a true digital sequence, each sample in x[k ] is approximated to a finite set 
of values. The last step is referred to as quantization and is the focus of our 
discussion in this section. 

9.3.1 Uniform and non-uniform quantization 

Figure 9.12(a) illustrates the input-output relationship for an L-level uniform 
quantizer. The peak-to-peak range of the input sequence x[k ] is divided uni- 
formly into (L + 1) quantization levels {do, d\, . . ., d L } such that the sepa- 
ration A = (d m+ 1 - cl ,,, ) is the same between any two consecutive levels. The 
separation A between two quantization levels is referred to as the quantile inter- 
val or quantization step size. For a given input, the output of the quantizer is 
calculated from the following relationship: 

1 

y[k] = r m = ~[d m + d m+ 1 ] for d m < x[k] < d m+ 1 and 0 <m<L. 

(9.27) 
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In other words, the quantized value of the input lying within the levels d n , and 
d m+ 1 is given by r m , which equals 0.5 (d m + d m +i). The quantization levels 
{do, d\ , ...,(//} are referred to as the decision levels, while the output levels 
{/'o, r\, 7'l_ i} are referred to as the reconstruction levels. 

Equation (9.27) approximates the analog sample values by using a finite 
number of quantization levels. The approximation introduces a distortion, which 
is referred to as the quantization error. The peak value of the quantization error 
is one-half of the quantile interval in the positive or negative direction. 

The quantizer illustrated in Fig. 9. 12(a) is called a uniform quantizer because 
the quantization levels are uniformly distributed between the minimum and 
maximum ranges of the input sequence. In most practical applications, the 
distribution of the amplitude of the input sequence is skewed towards low 
values. In speech communication, for example, low speech volumes dominate 
the sequence most of the time. Large-amplitude values are extremely rare and 
typically occupy only 15% to 25% of the communication time. A uniform 
quantizer will be wasteful, with most of the quantization levels rarely used. 
In such applications, we use non-uniform quantization, which provides fine 
quantization at frequently occurring lower volumes and coarse quantization at 
higher volumes. The input-output relationship of a non-uniform quantizer is 
shown in Fig. 9.12(b). The quantile interval is small at low values of the input 
sequence and large at high values of the sequence. 

Example 9.3 

Consider an audio recording system where the microphone generates a CT 
voltage signal within the range [—1, 1] volts. Calculate the decision and recon- 
struction levels for an eight-level uniform quantizer. 

Solution 

For an L — 8 level quantizer with peak-to-peak range of [—1, 1] volts, the 
quantile interval A is given by 

1 - (- 1 ) 

A = = 0.25 V. 

8 

Starting with the minimum voltage of — 1 V, the decision levels d m are uniformly 
distributed between — 1 V and 1 V. In other words, 

d m = — 1 + m A for 0 < m < L. 

Substituting different values of m , we obtain 


d m = - 1 V, -0.75 V, -0.5 V, -0.25 V, 0 V, 0.25 V, 
0.50 V, 0.75 V, IV. 


412 


Part III Discrete-time signals and systems 


Fig. 9.13. Derivation of a PCM 
sequence from a CT signal x(t). 
The original CT signal x(t) is 
shown by the dotted line, while 
the PCM sequence is shown as a 
stem plot. 
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Using Eq. (9.27), the reconstruction levels r m are given by 

r m = -0.875 V, -0.625 V, -0.375 V, -0.125 V, 0.125 V, 

0.375 V, 0.625 V, 0.875 V. 

The maximum quantization error is one-half of the quantile interval A and is 
given by 0.125 V. 


9.3.1.1 Pulse code modulation 

Pulse code modulation (PCM) is the analog-to-digital conversion of a CT signal, 
where the quantized samples of the CT signal are represented by finite-length 
digital words. The essential features of PCM are illustrated in Fig. 9.13, where 
a CT signal, with a peak-to-peak range of ± 1 V, is sampled and quantized by an 
eight-level uniform quantizer. As derived in Example 9.3, the decision levels 
d m are located at [- 1 V, -0.75 V, -0.5 V, -0.25 V, 0 V, 0.25 V, 0.50 V, 0.75 V, 1 
V], while the corresponding reconstruction levels r m are located at [—0.875 V, 
-0.625 V, -0.375 V, -0.125 V, 0.125 V, 0.375 V, 0.625 V, 0.875 V], Since there 
are eight reconstruction levels, each quantized sample can be encoded by a 
minimum of i = log 2 (L) = log 2 (8) = 3-bit word. We assign the 3-bit word 
000 to the reconstruction level ro = —0.875 V, 001 to the reconstruction level 
r i = —0.625, and so on for the remaining reconstruction levels as shown in 
Fig. 9.13. The PCM representation of the waveform x(t) shown in Fig. 9.13 is 
therefore given by the following bits: 

[Oil 010 001 000 001 111 111 110 101 100], 
where the final output is parsed in terms of 3 -bit codewords. 


9.3.2 Fidelity of quantized signal 

In Table 9.2, we list the sampling frequency, the total number of quantization 
levels, and the resulting raw (uncompressed) data rate for a number of commer- 
cial audio applications. Low-fidelity applications, for example the telephone 
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Table 9.2. Raw data rates for digital audio used in commercial applications 


Applications 

Bandwidth 

(Hz) 

Sampling rate 
(samples/s) 

Quantization 
levels (L) 

Raw data rate 
(byte s/s) 

Telephone 

200-3400 

8000 

2 s 

8000 

AM radio 


11025 

2 8 

11025 

FM radio (stereo) 


22050 

2 1S 

88 200 

CD (stereo) 

20-20000 

44100 

2 16 

176400 

Digital audio tape (stereo) 

20-20000 

48 000 

2 16 

192 000 


and the AM radio, are sampled at a relatively low sampling rate followed by 
a coarse quantizer to generate the PCM sequence. The quality of the recon- 
structed audio is moderate in such applications. In high-fidelity applications, 
for example the FM radio, compact disc (CD), and digital audio tape (DAT), 
the sampling rate is much higher to ensure accurate reconstruction of the high- 
frequency components. The number of levels in the quantizer is also increased 
to 2 16 to reduce the effect of the quantization error. Two channels, one for 
the right speaker and the other for the left speaker, are transmitted for high- 
fidelity applications. Compared to a single channel, the data rate is effectively 
doubled with the transmission of two channels. The CD and DAT provide 
excellent audio quality and are generally recognized as world standards for 
achieving fidelity of audio reproduction that surpasses any other existing tech- 
nique. In the following section, we discuss the CD digital audio system in more 
detail. 


9.4 Compact discs 


The compact disc (CD) digital audio system was defined jointly in 1979 by the 
Sony Corporation of Japan and the Philips Corporation of the Netherlands. The 
most important component of the CD digital audio system is an optical disc 
about 120 mm in diameter, which is used as the storage medium for recording 
data. The optical disc is referred to as the compact disc (CD) and stores about 
10 10 bits of data in the form of minute pits. To read data, the CD is optically 
scanned with a laser. 

Before music can be recorded on a CD, it is preprocessed and converted 
into PCM data. The schematic diagram of the preprocessing stage for a single 
music channel is illustrated in Fig. 9.14(a). Each channel of the music signal is 
amplified and applied at the input of a lowpass filter (LPF), referred to as the anti- 
aliasing filter. Since the human ear is only sensitive to frequency components 
within the range 20 Hz-20 kHz, the anti-aliasing filter limits the bandwidth of 
the input channel to 20 kHz. Following the anti-aliasing filter is the PCM system, 
which converts the CT music channel into binary data. The sampling rate used in 
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Fig. 9.14. Storing digital music 
on a compact disk. 

(a) Preprocessing stage to 
convert CT music channels into 
PCM data, (b) Multiplexing stage 
to interleave data from multiple 
channels. 



(a) 



(b) 


the sample-and-hold circuit is 44. 1 ksamples/s, which exceeds the Nyquist rate 
by a margin of 4.1 ksamples/s. The additional margin reduces the complexity 
of the anti-aliasing filter by allowing a fair transition bandwidth between the 
pass and stop bands of the filter. The audio samples obtained from the sample- 
and-hold circuit are quantized using 2 16 -level uniform quantization. Finally, 
each quantized sample is encoded with a 16-bit codeword, which results in a 
raw data rate of (44 100 samples/s x 16 bits/sample) = 705.6 kbits per second 
(kbps) or 705.6/8 = 88.2kBytes per second (kBps). 

For high-fidelity performance, several channels of the music signal are 
recorded on a CD. For commonly used stereo systems, only two channels 
corresponding to the left and right speakers are recorded. Many home theatre 
systems now record a much higher number of channels to simulate surround 
sound and other audio effects. Each channel of the music signal is prepro- 
cessed by the system illustrated in Fig. 9.14(a) and converted into raw PCM 
data. Figure 9.14(b) illustrates the multiplexing stage, where data streams from 
different channels are interleaved together into a single continuous bit stream. 
The final step in the multiplexing stage is an error control scheme, which adds 
an additional layer of protection to the music data. Any scanning errors that 
were introduced whilst data were being read out from the CD are concealed 
by the error control scheme. The output of the error control circuit is stored on 
the CD. To record more music on a single CD, PCM data may be compressed 
using an audio compression standard such as MP3. 

A CD player reverses each step illustrated in Fig. 9.14. Data read from the 
CD is checked for possible scanning errors. After correcting or concealing 
the detected errors, the data streams for the individual channels are derived from 
the interleaved bit stream. By following the reconstruction procedure outlined 
in Section 9.1.1, each data stream is used to reconstruct the corresponding music 
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channel. The reconstructed channels are played simultaneously to simulate the 
effect of real audio. 

Example 9.4 

Consider a digital monochrome CCD camera that records an image x[m, n] 
at a resolution of 800 x 1200 picture elements (pixels). In other words, each 
image consists of 800 x 1200 = 0.96 x 10 6 pixels. Assuming that the human 
visual system cannot distinguish between more than 200 different shades of 
gray, determine how many bytes are required to store a single image. If the 
CCD camera has 32 million bytes of memory space to store images, how many 
images can be saved simultaneously in the camera? 

Solution 

An image pixel can have 200 different shades of gray. The number of bits 
required to represent the intensity value of each pixel is given by |"log 2 (200)] 
or [7.64] or 8 bits; 

space required to save one image 
= 0.96 x 10 6 pixels x 8 bits/pixel 
= 7.68 x 10 6 bits or 0.96 x 10 6 bytes. 

Since the disc space for storing images is 32 x 10 6 bytes, 

number of images that can be stored simultaneously 
= 32 x 10 6 bytes/0.96 x 10 6 bytes 
= 33. 


9.5 Summary 


In this chapter, we introduced the principle of sampling that is used to transform 
a CT baseband signal into an equivalent DT sequence. Section 9. 1 discussed 
the ideal impulse-train sampling, where a periodic impulse train is multiplied 
by a CT baseband signal, resulting in a sequence of equally spaced samples at 
the location of the impulses ( t = kT s ). In the frequency domain, the spectrum 
of the sampled signal consists of several shifted replicas of the spectrum of the 
original signal. We observe that the original CT signal is recoverable from its 
DT version by ideal lowpass filtering if the sampling rate f s = I /T s is greater 
than twice the highest frequency present in the baseband signal. This condition 
is referred to as the sampling theorem. Violating the sampling theorem distorts 
the spectrum of the original baseband signal; a phenomenon known as aliasing. 

In practice, impulses are difficult to generate and are often approximated by 
narrow rectangular pulses. This leads to a more practical approach to sampling, 
covered in Section 9.2, in which a periodic rectangular pulse train is multiplied 
by the CT baseband signal to produce the sampled signal. Compared with the 
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ideal impulse train sampling, the spectra of the two sampled signals are identical, 
except that the shifted replicas in the spectrum of the pulse-train are attenuated 
by a sine function. Reconstruction of the original signal in rectangular pulse- 
train sampling is also achieved by lowpass filtering the sampled signal. A second 
practical implementation of sampling uses a zero-order hold circuit to sample 
the CT signal; this is covered in Section 9.2.2. 

To encode a CT signal into a digital waveform, Section 9.3 introduces the 
process of quantization, in which the values of the samples are approximated to a 
finite set of levels. This involves replacing the exact sample value with the closest 
level defined by the L -level quantizer. In uniform quantization, the quantization 
levels are distributed uniformly between the maximum and minimum ranges 
of the input sequence. A uniform quantizer results in high quantization error 
in most practical applications, where the distribution of the sample values is 
skewed towards low amplitudes. In such cases, most of the quantization levels 
in the uniform quantizer are rarely used. A non-uniform quantizer reduces the 
overall quantization error by providing finer quantization at frequently occurring 
lower amplitudes and coarser quantization at less frequent higher amplitudes. 

Sampling is used in a number of important applications. Section 9.4 intro- 
duces the compact disc (CD) and illustrates how sampling and quantization are 
used to convert an analog music signal into binary data, which can be stored on 
a CD. Since digital signals are less sensitive to distortion and interference than 
analog signals, the audio CD provides excellent audio quality that surpasses 
most analog storage mechanisms. 


9.1 For the following CT signals, calculate the maximum sampling period T s 
that produces no aliasing: 

(a) X\(t) — 5 sinc(200t); 

(b) X 2 (t) = 5 sinc(200?) + 8 sin(lOOjrf); 

(c) X?, (t) = 5 sinc(200?) sin(1007Tt); 

(d) J 4 (t) = 5 sinc(200?) * sin(1007Tt), where * denotes the CT convolu- 
tion operation. 

9.2 A famous theorem known as the uncertainty principle states that a baseband 
signal cannot be time-limited. By calculating the inverse CTFT of the 
following baseband signals, show that the uncertainty principle is indeed 
satisfied by the following signals (assume that coq and W are real, positive 
constants): 


Problems 



(b) X2(a>) 


1 \co\ < W 
0 elsewhere; 
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( a) — con \ 

2W J +re 

(d) X4 (co) = u(co — coq) — uioo — 2coq). 


COq 


2 W 


9.3 The converse of the uncertainty principle, explained in Problem 9.2, is 
also true. In other words, a time-limited signal cannot be band-limited. By 
calculating the CTFT of the following time-limited signals, show that the 
converse of the uncertainty principle is indeed true (assume that r, T , and 
a are real, positive constants): 

(a) xi (?) = cos(co 0 t)[u(t + T) - u(t - T)]; 


(b) x 2 (t) = rect( - 


* recti — 


(* denotes the CT convolution operator); 


(c) X 3 (t) = e “ |f| rect^- 

(d) x 4 (t) = S(t - 5) + 8(t + 5). 

9.4 The CT signal x{t) = v 1 (?) v 2 {t) is sampled with an ideal impulse train: 


s(t) = 8(t- kT s ). 


k=—oo 


(a) Assuming that vi(f) and v 2 {t) are two baseband signals band-limited 
to 200 Hz and 450 Hz, respectively, compute the minimum value of 
the sampling rate f s that does not introduce any aliasing. 

(b) Repeat part (a) if the waveforms for v\{t) and V 2(0 are given by the 
following expression: 


v 1 (? ) = sinc(600/‘) and V 2(0 = sinc( 1000 ?)- 


(c) Assuming that a sampling interval of T s = 2 ms is used to sample 
x(t) = vi(f)v 2(0 specified in part (b), sketch the spectrum of the sam- 
pled signal. Can x(t) be accurately recovered from the sampled signal? 

(d) Repeat part (c) for a sampling interval of T s = 0.1 ms. 

9.5 The CT signal x(t) — sin(400jrf) + 2 cost 1 5()nt) is sampled with an ideal 
impulse train. Sketch the CTFT of the sampled signal for the following 
values of the sampling rate: 

(a) f s = 100 samples/s; 

(b) f s = 200 samples/s; 

(c) / s = 400 samples/s; 

(d) / s = 500 samples/s. 

In each case, calculate the reconstructed signal using an ideal LPF with the 
transfer function given in Eq. (9.7) and a cut-off frequency of co s /2 = n f s . 
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9.6 Consider the following CT signal: 


x(t) = 


0.25(3 — |f |) 0 < |r| < 3 


0 


otherwise. 


(a) Calculate the CTFT X(a>). Determine the bandwidth of the signal and 
the ideal Nyquist sampling rate. 

(b) If the bandwidth is infinite, approximate the bandwidth as /I Hz, such 
that 

|X(<u)| < 0.01 max|X(&>)| for \co\ > 2 nfi 

and recalculate a practical Nyquist sampling rate. 

(c) Discretize x{t ) using a sampling interval of T s = 1 s. Plot the resulting 
DT sequence _v[/c] corresponding to the duration —5<t <5. 

(d) Quantize the signal x[k ] obtained in (c) with the uniform quantizer 
derived in Example 9.3. Plot the quantization error with respect to k. 
What is the maximum value of the quantization error? 

(e) Repeat (d) using a uniform quantizer with L = 16 reconstruction levels 
defined within the dynamic range [—1, 1]. Plot the quantization error 
with respect to k. What is the maximum value of the quantization error? 
Compare the plot with your answer obtained in (d). 

9.7 Show that the CTFS representation of the rectangular pulse train r(t) as 
defined in Eq. (9.17) is given by Eq. (9.19). 

9.8 The spectrum of a CT signal x(t) satisfies the following conditions: 

X(co) = 0 for \co\ < cui or \u>\ > co 2 with a >2 > a>i > 0. 

In other words, the CTFT X(a>) of x(t) is non-zero only within the range 
of frequencies o>\ < \a>\ < o:>n ■ Such a signal is referred to as a bandpass 
signal. 

(a) Show that the bandpass signal x(t) can be sampled with an ideal 
impulse train at a rate less than the Nyquist rate of 2 (o)t/2 tt) 
samples/s and can be perfectly reconstructed with a bandpass filter 
with the following transfer function: 


(b) Determine the minimum sampling rate for which perfect reconstruction 
is possible. 

(c) Compute the values of parameters p, a> t , and &> u used to specify the 
transfer function of the bandpass filter. 



9.9 An alternative to the bandpass sampling procedure introduced in 
Problem 9.8 is the system illustrated in Fig. P9.9. For a real-valued 
bandpass signal x(t) with the spectrum shown in Fig. P9.9(a), the 
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X(w) 


i'.AA. 


tflp(W) 


-o), -co, 0 co, co, 


(a) 



Fig. P. 9.9. (a) Spectrum of a 
bandpass signal x(Z); (b) ideal 
sampling of a bandpass 
baseband signal. 


cut-off frequency of the ideal LPF H\ v (oo) in Fig. P9.9(b) is given by 
a> c = 0.5(ft>2 — a>i)- 

(a) Sketch the spectrum of the sampled signal x s (t). 

(b) Determine the maximum value of the sampling interval T s that intro- 
duces no aliasing. Compare this sampling interval with that obtained 
from the Nyquist rate. 

(c) Implement a reconstruction system to recover x(t) from the sampled 
signal x s (t). 


9.10 


| s(0 



27 , 7 , 0 7 , 27 , 


Fig. P. 9.10. Sawtooth function 
used in sawtooth wave 
sampling. 


An alternative to ideal impulse train sampling is sawtooth wave sampling. 
Here, a CT signal x(t) is multiplied with a periodic sawtooth wave s(t) 
(shown in Fig. P9.10). Denote the resulting signal by z(r) = x(t) * s(t). 

(a) Derive an expression for the CTFT Z(co) of the signal z(t) in terms 
of the CTFT of the original signal x(t). 

(b) Assuming that the CTFT of the original signal x(t) is shown in 
Fig. 9.3(a), sketch the spectrum of the CTFT of the signal z(t). 

(c) Based on your answer to part (b), can x(t) be reconstructed from z(f )? 
If yes, state the conditions under which x(t) may be reconstructed. 
Sketch the block diagram of the reconstruction system including the 
specifications of any filters used. 

(d) By comparing the CTFTs, state how z(f) relates to the sampled signal 
x s (t) obtained by ideal impulse train sampling. 


9.11 Repeat Problem 9.10 with an alternating sign impulse train, 

OO 

s(t)= (“I ) k S(t~kT s ), 

k=—oo 

as the sampling signal. 


9.12 Repeat Problem 9.10 with the periodic signal, 

OO 

s(t)= J2 m-kT s ) + 8(t-A-kT s )], 

k= — OO 


as the sampling signal. 
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9.13 A CT band-limited signal x(t) is sampled at its Nyquist rate f s and trans- 
mitted over a band-limited channel modeled with the transfer function 


^ch(tn) — 


1 

0 


4t r/ s < M < 8 j r/ s 

otherwise. 


Let the signal received at the end of the channel be .r c h(0- Determine the 
reconstruction system that recovers the CT signal x(t) from x C h(f). 

9.14 If the quantization noise needs to be limited to ±p% of the peak-to-peak 
value of the input signal, show that the number of bits in each PCM word 
must satisfy the following inequality: 

n > 3.321og 10 . 

9.15 A voice signal with a bandwidth of 4 kHz and an amplitude range of 
±20 mV is converted to digital data using a PCM system. 

(a) Determine the maximum sampling interval T s that can be used to 
sample the voice signal. 

(b) If the PCM system has an accuracy of ±5% during the quantization 
step, determine the length of the codewords in bits. 

(c) Determine the data rate in bps (bits/s) of the resulting PCM sequence. 

9.16 A baseband signal with a bandwidth of 100 kHz and an amplitude range 
of ± 1 V is to be transmitted through a channel which is constrained to 
a maximum transmission speed of 2 Mbps. Your task is to design a uni- 
form quantizer that introduces minimum quantization error. Determine 
the maximum number of levels L in the uniform quantizer. What is the 
maximum distortion introduced by the uniform quantizer? Assume the 
Nyquist rate for sampling. 

9.17 Consider the input-output relationship of an ideal sampling system given 
by 

00 oo 

x s (t) = x(t) ^ S(t - kT s ) = ^ x(kT s )8(t - kT s ). 

k = — oo k=—o o 

Determine if the ideal sampling system is (i) linear, (ii) time-invariant, 
(iii) memoryless, (iv) causal, (v) stable, and (vi) invertible. 

9.18 Consider the input-output relationship of a DT quantizer with L decision 
levels, given by 

1 

y[k] = Q{x[k]} = ~[d m +d m + 1 ] for d m < x[k] < d m+] and 
0 < m < L. 


Determine if the DT quantizer is (i) linear, (ii) time-invariant, (iii) mem- 
oryless, (iv) causal, (v) stable, and (vi) invertible. 
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9.19 Consider a digital mp3 player that has 1024 x 10 6 bytes of memory. 

Assume that the audio clips stored in the player have an average duration 

of five minutes. 

(a) Assuming a sampling rate of 44 100 samples/s and 16 bits/sample/ 
channel quantization, determine the average storage space required 
(without any form of compression) to store a stereo (i.e. two-channel) 
audio clip. 

(b) Assume that the audio clips are stored in the mp3 format, which 
reduces the audio file size to roughly one-eighth of its original size. 
Calculate the storage space required to store an mp3-compressed 
audio clip. 

(c) How many mp3-compressed audio files can be stored in the mp3 
player? 

9.20 Consider a digital color camera with a resolution of 2560 x 1920 pixels. 

(a) Calculate the storage space required to store an image in the camera 
without any compression. Assume three color channels and quanti- 
zation of 8 bit/pixel/channel. 

(b) Assume that the images are stored in the camera in the JPEG format, 
which reduces an image to roughly one-tenth of its original size. 
Calculate the storage space required to store a JPEG-compressed 
image. 

(c) If the camera has 512 x 10 6 bytes of memory, determine the number 
of JPEG-compressed images that can be stored in the camera. 


CHAPTER 



Time-domain analysis of 
discrete-time systems 


An important subset of discrete-time (DT) systems satisfies the linearity and 
time-invariance properties, discussed in Chapter 2. Such DT systems are 
referred to as linear, time-invariant, discrete-time (LTID) systems. In this chap- 
ter, we will develop techniques for analyzing LTID systems. As was the case 
for the LTIC systems discussed in Part II, we are primarily interested in cal- 
culating the output response y[k] of an LTID system to a DT sequence x[k] 
applied at the input of the system. 

In the time domain, an LTID system is modeled either with a linear, constant- 
coefficient difference equation or with its impulse response h[k]. Section 10.1 
covers linear, constant-coefficient difference equations and develops numer- 
ical techniques for solving such equations. Section 10.2 defines the impulse 
response h[k] as the output of an LTID system to an unit impulse function <5 [k ] 
applied at the input of the system and shows how the impulse response can 
be derived from a linear, constant-coefficient difference equation. Section 10.3 
proves that any arbitrary DT sequence can be represented as a linear combina- 
tion of time-shifted DT impulse functions. This development leads to a second 
approach for calculating the output y[k ] based on convolving the applied input 
sequence x[k ] with the impulse response h[k] in the DT domain. The resulting 
operation is referred to as the convolution sum and is defined in Section 10.4. 
Section 10.5 introduces two graphical methods for calculating the convolution 
sum, and Section 10.6 lists several important properties of the convolution sum. 
A special case of convolution sum, referred to as the periodic or circular con- 
volution, occurs when the two operands are periodic sequences. Section 10.7 
develops techniques for computing the periodic convolution and shows how 
it may be used to compute the linear convolution. In Section 10.8, we revisit 
the causality, stability, and invertibility properties of LTID systems and express 
these properties in terms of the impulse response h[k], Matlab instructions 
for computing the convolution sum are listed in Section 10.9. The chapter is 
concluded in Section 10.10 with a summary of the important concepts covered 
in the chapter. 
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10.1 Finite-difference equation representation of LTID systems 


As discussed in Section 3.1, an LTIC system can be modeled using a linear, 
constant-coefficient differential equation. Likewise, the input-output relation- 
ship of a linear DT system can be described using a difference equation, which 
takes the following form: 

y[k + n] + a„-\y[k + n — 1] H f a 0 y[k ] 

= b m x[k + m] + b m -\x[k + m — 1] + • • • + bQx[k], (10.1) 

where x[k ] denotes the input sequence and y[k] denotes the resulting out- 
put sequence, and coefficients a r (for 0 < r < n — 1), and b, (for 0 < r <m) 
are parameters that characterize the DT system. The coefficients a r and b, 
are constants if the DT system is also time-invariant. For causal signals and 
systems analysis, the following n initial (or ancillary) conditions must be spec- 
ified in order to obtain the solution of the nth-order difference equation in 
Eq. (10.1): 


y[-Hy[-2],...,y[-n]. 

We now consider an iterative procedure for solving linear, constant-coefficient 
difference equations. 

Example 10.1 

The DT sequence x[k] = 2ku\k \ is applied at the input of a DT system described 
by the following difference equation: 

y[k+ 1] — 0.4 y[k\=x[k]. 

By iterating the difference equation from the ancillary condition y[— 1] = 4, 
compute the output response y[k] of the DT system for 0 < k <5. 

Solution 

Express y[k + 1] — QAy[k ] = x\k ] as follows: 

y[k] = 0Ay[k-l] + x[k-l] 

= 0Ay[k - 1] + 2 (k - 1) u(k - 1) { v x[k] = 2k u[k ]} , 

which can alternatively be expressed as 

QAy[k - 1] k = 0 

0Ay[k - 1] + 2(k - 1) k> 1. 


y[k] = 
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Fig. 10.1. Input and output 
sequences for Example 10.1. 

(a) Input sequence x[k]] 

(b) output sequence y[k\. 



(a) (b) 


By iterating from k = 0, the output response is computed as follows: 
y[0] = 0.4y[-l] = 1.6, 
y[l] = 0.4 v[0] + 2x0 = 0.64, 
y[2] = 0.4y[l] + 2 x 1 = 2.256, 
y[ 3] = 0.4y[2] + 2 x 2 = 4.902, 
y[ 4] = 0.4y[3] + 2 x 3 = 7.961, 
v [5] = 0.4 y [4] + 2x4= 11.184. 

Additional values of the output sequence for k > 5 can be similarly evaluated 
from further iterations with respect to k. The input and output sequences are 
plotted in Fig. 10.1 for 0 < k < 5. 


In Chapter 3, we showed that the output response of a CT system, represented by 
the differential equation in Eq. (3.1), can be decomposed into two components: 
the zero-state response and the zero-input response. This is also valid for the 
DT systems represented by the difference equation in Eq. (10.1). The output 
response y[k ] can be expressed as 

y[k] = y^k] + 3+W, (10.2) 

zero-input response zero-state response 

where y z i[£] denotes the zero-input response (or the natural response) of the 
system and y zs | k ] denotes the zero-state response (or the forced response) of 
the DT system. 

The zero-input component y z i[£] for a DT system is the response produced by 
the system because of the initial conditions, and is not due to any external input. 
To calculate the zero-input component y n [&], we assume that the applied input 
sequence x[k\ = 0. On the other hand, the zero-state response y zs [A:] arises due 
to the input sequence and does not depend on the initial conditions of the system. 
To calculate the zero-state response y zs [&;], the initial conditions are assumed 
to be zero. Based on Eq. (10.2), a DT system represented by Eq. (10.1) can 
be considered as an incrementally linear system (see Section 2.2.1) where the 
additive offset is caused by the initial conditions (see Fig. 2.10). If the initial 
conditions are zero, the DT system becomes on LTID system. We now solve 
Example 10. 1 in terms of the zero-input and zero-state components of the output. 

Example 10.2 

Repeat Example 1 0. 1 to calculate (i) the zero-input response y z ; [k], (ii) the zero- 
state response y zs [A:], and (iii) the overall output response y[k] for 0 < k < 5. 
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Solution 

(i) The zero-input response of the system is obtained by solving the following 
difference equation: 


y[k+ l] - 0Ay[k] = x[k], 

with input x [A:] = 0 and ancillary condition y[— 1] = 4. The difference equation 
reduces to 


y zi [k] = 0Ay zl [k- 1], 


with ancillary condition y z i[— 1] = 4. Iterating for k = 0, 1, 2, 3, 4, and 5 yields 

V zi [0] = 0.4y zi [— 1] = 1.6, 

Vzi [ 1 ] = 0.4y zi [0] = 0.64, 
y zi [2] = 0.4y zi [l] = 0.256, 
y zi [3] = 0.4y z j [2] = 0.1024, 

.Vzi [4] = 0.4y zi [3] = 0.0410, 

Vzi [5] = 0.4y z j [4] = 0.0164. 

(ii) The zero-state response of the system is calculated by solving the fol- 
lowing difference equation: 

y zs [k] = 0.4 y zs [k - 1] + 2(k - 1 )u[k - 1], 

with ancillary condition _y Z s [ — 1 ] = 0. Iterating the difference equation for 
k = 0, 1, 2, 3, 4, and 5 yields 

y zs [0] = 0.4 v zs [ — 1 ] + 2 x (-1) x 0 = 0, 
y zs [l] = 0.4v zs [0] + 2 x 0 x 1 = 0, 
y zs [2] = 0.4y zs [l] + 2 x 1 x 1 = 2, 
y zs [3] = 0.4 v zs [2] + 2x2x1= 4.8, 
y zs [4] = 0.4 v zs [3] + 2x3x1= 7.92, 
y zs [5] = 0.4v zs [4] + 2x4x1 = 11.168. 

(iii) Adding the zero-input and zero-state components obtained in parts 
(i) and (ii), yields 


y[0] = y zi [0] + y zs [0] = 1.6, 
y[i] = yzi[i] + yz.[i] = o.64, 

y[ 2] = Vzi [2] + y zs [2] = 2.256, 
y[ 3] = v zi [3] + y zs [3] = 4.902, 
j[4] = y zi [4] + y zs [4] = 7.961, 
j[5] = y zi [5] + y zs [5] = 11.184. 


Note that the overall output response y[k] is identical to the output response 
obtained in Example 10.1. By iterating with respect to k, additional values for 
the output response y[fc] for k > 5 can be computed. 
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In Section 10.1, we used a linear, constant-coefficient difference equation to 
model an LTID system. A second model is based on the impulse response h[k ] 
of a system. This alternative representation leads to a different approach for 
analyzing LTID systems. Section 10.2 presents this alternative approach. 


10.2 Representation of sequences using Dirac delta functions 


In this section, we show that any arbitrary sequence x[k] may be represented as 
a linear combination of time-shifted, DT impulse functions. Recall that a DT 
impulse function is defined in Eq. (1.51) as follows: 


S[k] = 


1 k = 0 

0 k / 0. 


(10.3) 


We are interested in representing any DT sequence x[k\ as a linear combina- 
tion of shifted impulse functions, 8[k — m ] , for — oo < m < oo. We illustrate 
the procedure using the arbitrary function x[k ] shown in Fig. 10.2(a). Figures 
10.2(b)-(f) represent x[k] as a linear combination of a series of simple functions 
x m [£],for — oo < m < oo. Since x m [£] is non-zero only at one location (k — m), 
it represents a scaled and time-shifted impulse function. In other words, 


x m [k ] — x\m]8[k — m]. 


(10.4) 


Fig. 10.2. Representation of a 
DT sequence as a linear 
combination of time-shifted 
impulse functions, (a) Arbitrary 
sequence x[k\, (b)-(f) its 
decomposition using DT impulse 
functions. 


In terms of x m \k], the DT sequence x | k | is, therefore, represented by 
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+ x[l]5[^ - 1] + x[2]8[k - 2] + ■ ■ • , 
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which reduces to 

OO 

*[*:]= x[m]8[k-m]. (10.5) 

777=— OO 

Equation (10.5) provides an alternative representation of an arbitrary DT func- 
tion using a linear combination of time-shifted DT impulses. In Eq. (10.5), 
variable m denotes the dummy variable for the summation that disappears as 
the summation is computed. Recall that a similar representation exists for the 
CT functions and is given by Eq. (3.24). 

10.3 Impulse response of a system 


In Section 1 0. 1 , a constant-coefficient difference equation is used to specify the 
input-output characteristics of an LTID system. An alternative representation of 
an LTID system is obtained by specifying its impulse response. In this section, 
we will formally define the impulse response and illustrate how the impulse 
response of an LTID system can be derived directly from the difference equation 
modeling the LTID system. 

Definition 10.1 The impulse response h[k] of an LTID system is the output of 
the system when a unit impulse 8[k] is applied at the input of the LTID system. 
Following the notation introduced in Eq. (2.1b), the impulse response can be 
expressed as follows: 

<5 [it] -* h[k], (10.6) 

with zero ancillary conditions. 

Note that an LTID system satisfies the linearity and the time-shifting properties. 
Therefore, if the input is a scaled and time-shifted impulse function aS[k — L>], 
the output, Eq. (10.6), of the DT system is also scaled by a factor of a and 
time-shifted by ko, i.e. 


a8[k - k 0 ] ah[k - k 0 \, (10.7) 

for any arbitrary constants a and kg. Section 10.4 illustrates how Eq. (10.7) can 
be generalized to calculate the output of LTID systems for any arbitrary input. 

Example 10.3 

Consider the LTID systems with the following input-output relationships: 

(i) y[k] = X[k - 1] + 2 x[k - 3]; (10.8) 

(ii) y[k + 1] - 0.4 y[k] = x[k], (10.9) 

Calculate the impulse responses for the two LTID systems. Also, determine 
the output responses of the LTID systems when the input is given by x[k ] = 
28[k] + 38[k- 1], 
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Solution 

(i) The impulse response of a system is the output of the system when the input 
sequence x[k ] = <5[/:]. Therefore, the impulse response h[k) of system (i) can 
be obtained by substituting y[/r] by h[k\ and x[k\ by <5[&] in Eq. (10.8). In other 
words, the impulse response for system (i) is given by 

h[k] = 8[k- l] + 2S[k- 3], 

To evaluate the output response resulting from the input sequence x[k ] = 
2S[k ] + 3<5[fc — 1], we use the linearity and time-invariance properties of the 
system. The outputs resulting from the two terms 28 [A:] and 3 S[k — 1] in the 
input sequence are as follows: 

28[k] -> 2 h[k] = 2 8[k - 1] + 48 [k - 3] 


and 


3 8[k - 1] 3 h[k - 1] = 35[>t - 2] + 6 8[k - 4], 

Applying the superposition principle, the output y[£] to input x [ k ] = 28[k] + 
38 [k — 1] is given by 

28[k] + 3 8[k - 1] -* 2h[k] + 3 h[k - 1] 


or 


y[k] = (28[k - 1] + 48[k - 3]) + (38[k - 2] + 6 8[k - 4]) 

= 28[k - 1] + 3 8[k - 2] + 48[k - 3] + 68[k - 4]). 

(ii) On substituting y[/c] by h[k] and x[k ] by 5[A:] in Eq. (10.9), the impulse 
response of the LTID system (ii) is represented by the following recursive 
equation: 


h[k+ 1] - 0.4 h[k] = 5 [it], (10.10a) 

Equation (10. 10a) is a difference equation, which can be solved by substituting 
k = m — 1 . The resulting equation is given by 

h[m] = 8[m - 1] + 0.4/7 [m - 1], (10.10b) 

To solve for the delayed response h[m — 1], we substitute k — m—2 in 
Eq. (10.10a). The resulting expression is given by 

h[m - 1] = 8[m - 2] + 0.4/7[/n - 2], (10.10c) 

Substituting the above value of h[m— 1] from Eq. (10.10c) in Eq. (10.10a) 
yields 


h[m] = 8[m - 1] + QA8 [m - 2] + 0.4 2 /7[m - 3], 
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The aforementioned procedure can be repeated for the delayed impulse response 
h[m — 3] on the right-hand side of the equation, then for the resulting h[m — 4], 
and so on. The final result is as follows: 

h[m] = S[m - 1] + 0.4<5 [;« - 2] + 0.4 2 <5[m - 3] + 0.4 3 <5[/w - 4] + • ■ ■ 


or 


oo 

h[m] = A l - l &[m ~£\ = 0.4 m ~ ] u[m - 1] 

£= 1 


or 


h[k] = 0.4 k ~ l u[k- 1], 

which is the required expression for the impulse response of the system. 

Next, we proceed to calculate the output of the LTID system for the 
input sequence x[k ] = 28[k] + 3(5 [A: — 1]. Because the system is linear and 
time-invariant, the output sequence y[k] resulting from input x[k] — 28[k] + 
3 8 [k — 1] is given by 

2S[k] + 3S[k - 1] -> 2h[k] + 3 h[k - 1] 


or 


y[k] = 2 x 0 A k ~ l u[k - 1] + 3 x 0 A k ~ 2 u[k - 2] 

= 2 x 0.4°5[yt - 1] + (2 x 0.4 t_1 M[A: - 2] + 3 x 0.4 k ~ 2 u[k - 2]) 
= 2(5 [A: - 1] + 3.8 x 0.4 k ~ 2 u[k - 2], 


Example 10.4 

The impulse response of an LTID system is given by h[k] = 0.5 k u[k]. Deter- 
mine the output of the system for the input sequence x[k] = 8[k — I ] + 3<5|T — 
2] + 2S[k — 6]. 

Solution 

Because the system is LTID, it satisfies the linearity and time-shifting properties. 
The individual responses to the three terms 8[k — 1], 3(5 [A: — 2], and 2S[k — 6] 
in the input sequence x | k \ are given by 

S[k - 1] -► h[k - 1] = 0.5 k ~ l u[k - 1], 

3(5 [k - 2] 3h[k - 2] = 3 x 0.5 k ~ 2 u[k - 2], 


2S[k -6]-> 2 h[k - 6] = 2 x 0.5 k ~ 6 u[k - 6], 


and 
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Fig. 10.3. (a) Impulse response 
h[k\ of the LTID system specified 
in Example 10.4. (b) Output y[k] 
of the LTID system for input 
x[k ] = S[k - 1] + 3 S[k - 2] + 
28[k - 6]. 


3.5 



(a) 


(b) 


Applying the principle of superposition, the overall response to the input 
sequence x[/r] is given by 

y[k] = h[k- 1] + 3 h[k -2] + 2 h[k - 6], 

Substituting the value of h[k] = 0.5 k u[k] results in the output response: 

y[£] = 0.5 k ~ l u[k - 1] + 3 x 0.5 k ~ 2 u[k - 2] + 2 x 0.5 k ~ 6 u[k - 6] . 

The impulse response h[k] and the resulting output sequence are plotted in 
Figs 10.3(a) and (b). 


10.4 Convolution sum 


Examples 10.3 and 10.4 compute the output of an LTID system for relatively 
elementary input sequences x[k] consisting of a few scaled and time-shifted 
impulses. In this section, we extend the approach to more complex input 
sequences. 

It was shown in Eq. (10.5), which is reproduced below for clarity, that any 
arbitrary input sequence can be represented as a linear combination of time- 
shifted impulse functions as follows: 

OO 

x[k]= x[m]S[k - i? 1 ]. (10.11) 

m=—o o 

Note that in Eq. (10.11), x[m] is a scalar representing the magnitude of the 
impulse S[k — in ] located at k = m. In terms of the impulse response h[k], the 
output resulting from a single impulse x[m]S[k — m] is given by 


x[m]8[k — m ] 


x[m]h[k — m]. 


(10.12) 
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Fig. 10.4. Output response of a 
system to an arbitrary input 
sequence x[k]. 


x[A'] — Y,x [m\5[k—m\ 

m=—oo 


DT system 


> 


m 


>• y[&]= Hx[m]h[k-m ] = x[m]* h\m] 

m=—oo 


Applying the principle of superposition, the overall output y[k | resulting from 
the input sequence x[k\, represented by Eq. (10. 1 1), is given by 

OO OO 

x[m]8[k — m ] — >■ x[m]h[k — m], (10.13) 

m = — oo m =— oo 

x[k] y[k] 

where the summation on the right-hand side, used to compute the output 
response y[Ai], is referred to as the convolution sum. Equation (10.13) pro- 
vides us with a second approach for calculating the output y[k]. It states that 
the output y[k] can be calculated by convolving the input sequence x[k] with 
the impulse response h[k] of the LTID system. Mathematically, Eq. (10.13) is 
expressed as follows: 

OO 

v[k] = x[k] *h[k] = Y x[m]h[k-m], (10.14) 

m=—o o 

where * denotes the convolution sum. Figure 10.4 illustrates the process of 
convolution. The convolution operation defined in Eq. (10.14) is commonly 
referred to as the linear convolution, in contrast to a special type of convolution 
known as periodic convolution, which is discussed in Section 10.6. 

We now consider several examples to illustrate the steps involved in com- 
puting the convolution sum. 

Example 10.5 

Assuming that the impulse response of an LTID system is given by h[k] = 
0.5 k u[k], determine the output response y[£] to the input sequence x[k ] = 
0.8 k u[k], 

Solution 

Using Eq. (10.14), the output response y[k] of the LTID system is given by 

OO OO 

y[k]= x[m]h[k-m]= ^ 0.S m u[rn]0.5 k ~ m u[k - m]. 

m=—c o m=—o o 

Using the values of the unit step function u[m], the above summation simplifies 
as follows: 

OO 

y [k] = ^ 0.8 m 0.5 k ~'"u[k - m]. 

m= 0 

Depending on the value of k. the output response y[k] of the system may take 
two different forms for k > 0 or k < 0. We consider the two cases separately. 
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Fig. 10.5. Output of an LTID 
system, with impulse response 
h[k] = 0.2 k u[k], to the input 
sequence x[k] = 0.5*0 [A:] as 
calculated in Example 10.5. 


= y L0.8 i+1 -0.5* +1 ]«[A:] 

1.3f 29 1.16 



Case 1 (k < 0) When k 0, the unit step function i/[Ar in] — 0 w i t h i n the 
limits of summation (0 < m < oo). Therefore, the output sequence y[k] = 0 
for k < 0. 


Case II (k > 0) When k > 0, the unit step function u[k — in ] has the following 
values: 

1 m < k 


u[k — in] 


ll m > k. 


The output sequence y[k] is therefore given by 
y[k] = 0.8 m 0.5 i_m = 0.5" 

m= 0 m= 0 

for k > 0. The above summation represents a geometric progression (GP) series. 
Using the GP series sum formula provided in Appendix A, Section A. 3, the 
output response y[k] is calculated as follows: 


y[k] = 0.5" 


1 - (0. 8/0.5)' 


,*+i 


= — [0.8" +1 -0.5 i+1 ] 


1 - ( 0 . 8 / 0 . 5 ) 

Combining the two cases (k < 0 and k > 0), the output response y[k] is given 
by 


y[k] = 


0 k < 0 

— [0.8" +1 -0.5" +1 ] k> 0 

3 

= y[0.8" +1 -0.5 k+l ]u[k]. 

The output response of the system is plotted in Fig. 10.5. 


Example 10.5 shows how to calculate the convolution sum analytically. In 
many situations, it is more convenient to use a graphical approach to evaluate 
the convolution sum. Section 10.5 describes the graphical approach. 


10.5 Graphical method for evaluating the convolution sum 


The graphical approach for calculating the convolution sum is similar to the 
graphical procedure for calculating the convolution integral for the LTIC system, 
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discussed in Chapter 3. In the following, we highlight the main steps in calcu- 
lating the convolution sum between two sequences x[k ] and h[k]. 

Algorithm 10.1 Graphical procedure for computing the linear convolution 

(1) Sketch the waveform for input jc [m] by changing the independent variable 
of x[k] from k to m and keep the waveform for x[m] fixed during steps 

(2)-(7). 

(2) Sketch the waveform for the impulse response h[m] by changing the inde- 
pendent variable from k to m . 

(3) Reflect h[m] about the vertical axis to obtain the time-inverted impulse 
response h[— m], 

(4) Shift the sequence h[— m] by a selected value of k. The resulting function 
represents h[k — m], 

(5) Multiply the input sequence x [m ] by h [k — m] and plot the product function 
x[m]h[k — m], 

E OO 

x[m]h[k — m 1. 

m =— oo 

(7) Repeat steps (4)— (6) for — oo < k < oo to obtain the output response y[k] 
over all time k. 

The graphical approach for calculating the output response is illustrated through 
a series of examples. 

Example 10.6 

Repeat Example 10.5 with input x[k\ — 0.8 k u[k] and impulse response h[k] = 
().5 k u[k] to determine the output of the LTID system using the graphical con- 
volution approach. 

Solution 

Following steps ( 1 )— (3) of Algorithm 10.1, the DT sequences x[m] = 0.8 m n[/n], 
h[m] = 0.5 m u[m] and its time reflection h[—m] = 0.5 ~ m u[—m] are plotted in 
Fig. 10.6. Based on step (4), the sequence h[k — m] = h[—(m — k)] is obtained 
by shifting h[—m] by k samples. To compute the output sequence, we consider 
two cases based on the values of k. 

Case 1 For k < 0, the waveform h[k — m ] is on the left-hand side of the vertical 
axis. As is apparent in Fig. 10.6, step (5a), waveforms for/*[k — m ] and v [m ] do 
not overlap. In otherwords, the product jc[n7]/![k — m] = 0,for— oo < m < oo, 
as long as k < 0. The output sequence y[k] is therefore zero for k < 0. 

Case 2 For k > 0, we see from Fig. 10.6, step (5b), that the non-zero parts of 
h[k — m] and x[m] overlap over the range m = [0, k]. Therefore, 

k k 

y[k] = x[m]h[k - m ] = 0.8 m 0.5 fc “ m . 

m = 0 m = 0 
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Fig. 10.6. Convolution of the 
input sequence x[k] with the 
impulse response A [A] in 
Example 10.6. 


As shown in Example 10.5, the above summation simplifies to 
y[k] = y [0.8^ +1 - 0.5* +I ] for k > 0. 
Combining Cases 1 and 2, the overall output sequence is given by 
?[*] = y[0.8 t+1 — 0.5 i+1 ]«W. 

The final output response is plotted in Fig. 10.6, step (6). 


Example 10.7 

For the following DT sequences: 

0 < k < 4 
otherwise, 

calculate the convolution sum v[£] = x[k] * h[k] using the graphical approach. 

Solution 

Following steps (l)-(3) of Algorithm 10.1, the sequences x[m], h[m], and its 
reflection h[—m] are plotted as a function of the independent variable m in 
Fig. 10.7, steps (l)-(3). The DT sequence h\k — m\ — h[—(m — A:)] is obtained 
by shifting the time-reflected function /?[—/«] by k. Depending on the value of 
k, five special cases arise. We consider these cases separately. 

Case 1 For k < 0, we see from Fig. 10.7, step (5a), that the non-zero parts of 
h[k — m] and x[m] do not overlap. In other words, output y [ k \ = 0 for k < 0. 

Case 2 For 0 < k < 2, we see from Fig. 10.7, step (5b), that the non-zero parts 
of h[k — m] and x[m] overlap over the duration m = [0, k]. Therefore, the 


x[k] = 


2 0 < k < 2 
0 otherwise 


and h[k] = 


k+ 1 
0 


435 


10 Time-domain analysis of DT systems 


step (1) 


x\m\ 


MM 

-5 -4-3-2 -1 0 1 2 3 4 5 6 7 


step (4) 


h[k—m] 


I I I I I + + ++ + + + + 

Ui ^ W K) - -WW^UiOwiOO 


Step (5c) h[k-m]x[m ] 


-5 -4-3-2 -1 0 1 2 3 4 5 6 7 


??• 5*j« ?T* ??> ??» 

I I I I 

W K) — 


step (6) y[k] 

,, 18 18 io 

? | T 1 I M 

I T T T I M 


-5 -4-3-2 -1 0 1 2 3 4 5 6 7 


-t-k 


Step (2) 


h[m] 


-*-m * i 


-5 -4-3-2 -1 0 1 2 3 4 5 6 7 


step (5a) 


h[k-m]x[m] 


step (5d) 


h[k- m]x[m] 


step (3) 


h[-m] 


->-m -f- 


It 


-5 -4 -3-2-1 0 1 2 3 4 5 6 7 


step (5b) 


h[k— m]x[m] 


hu m 


-5 -4-3-2 -1 0 1 2 3 4 5 6 7 


?T- ?T- 

I I I I 
44 w to -- 


step (5e) 


h[k— m]x[m] 


-5 -4-3-2 -1 0 1 2 3 4 5 6 7 

?T- ??• ?T- 

I I I I 

4* U) N) i- 


* ‘ » * 


-5 -4-3-2 -1 0 1 2 3 4 5 6 7 


?T“ ??•??" ??• 
I I I I 

J4 W tO >- 


Fig. 10.7. Convolution of the 
input sequence x [£] with the 
impulse response h [£] in 
Example 10.7. 


output response for 0 < k < 2 is given by 

k k k k 

y[k] = E x[m]h[k — m] = 2 x (k — m + l) = 2 (k + 1) E * 1 “ 2 E m 

m = 0 m=0 m = 0 m= 0 

k 

= 2(k + l) 2 -2 Y^m. 

m=\ 

The summation Ylm = 1 m ' s an arithmetic progression (AP) series. Using the 
AP series summation formula provided in Appendix A, Section A. 3, the output 
response y[k] for 0 < k 5 2 is calculated as follows: 

y[k] = 2 (k + l) 2 - k(k +l) = k 2 + 3k + 2. 

Case 3 For 2 < k < 4, we see from Fig. 10.7, step (5c), that the non-zero part 
of h[k — m] completely overlaps x[m] over the region m = [0, 2]. The output 
response y[k] for 2 < k < 4 is given by 


y[k] — y ' x[m]h[k — m] = ^ ' 2 x (k — m + 1 ) 

m= 0 m= 0 

2 2 

= 2{k + 1) 1 - 2 E m = 6(Jt + 1) - 6 = 6k. 


u=0 


fi=0 
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Case 4 For 4 < k < 6, we see from Fig. 10.7, step (5d), that the non-zero part 
of h[k — m] partially overlaps x[m] over the region m = [A: — 4, 2]. The output 
v[&] for 5 < k < 6 is given by 


y[k] = 


2 2 

^ x[m]h[k — m] = 2 x (k — m + 1) 

m=k— 4 m=k—4 


2 2 



m=k — 4 m=k — 4 


= 2(ifc + 1)(7 -k)-(7- k)(k - 2) = -A: 2 + 3it + 8. 


Case 5 For A: > 6, we see from Fig. 10.7, step (5e), that the non-zero parts of 
h[k — m] and x[m] do not overlap. Therefore, the product x[m]h[k — in] = 0 
for all values of m. The value of the output sequence [A | = 0 for k > 6. 


Combining the above five cases, we obtain 


y[k] = 


0 

k 2 + 3k + 2 
6k 

- k 2 + 3k + 8 


k < 0, k > 6 
0 < k < 2 
2 < k < 4 
4 < k < 6, 


which is plotted in Fig. 10.7, step (6). 


10.5.1 Sliding tape method 

The graphical convolution approach, illustrated in Examples 10.6 and 10.7, 
for LTID systems is similar to the graphical convolution procedure for LTIC 
systems. However, sketching the figures for the time-reversed and time-shifted 
impulse functions may prove to be difficult in certain cases. There is a variant 
of the graphical method for DT convolution, known as the sliding tape method, 
which is convenient in cases where the convolved sequences are relatively 
short in length. Instead of drawing the figures in such cases, we compute the 
convolution sum using a table whose entries are the values of the DT sequences 
at different instances. We illustrate the sliding tape method in Examples 10.8 
and 10.9. 

Example 10.8 

For the two sequences x[k] and li[k] defined in Example 10.7, calculate the 
convolution y[&] = x[k] * h[k] using the sliding tape method. 

Solution 

The convolution of x [A:] and h [A:] using the sliding tape method is illustrated 
in Table 10.1. The first row represents the /n-axis; the second row represents 
the input sequence x[m\, and the third row represents the impulse response 
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Table 10.1. Convolution of x[k] and /j [/r] using the sliding tape method for Example 10.8 


m 

-5 

-4 

-3 

-2 

-1 

0 

1 

2 

3 

4 

5 

6 

7 

k 

y[k] 

x[m] 






2 

2 

2 








h [in ] 






1 

2 

3 

4 

5 






h[—m] 


5 

4 

3 

2 

1 










/z [ — 1 — in] 

5 

4 

3 

2 

1 









-i 

0 

S' 

0 

1 


5 

4 

3 

2 

1 








0 

2 

/7 [ 1 — m] 



5 

4 

3 

2 

1 







1 

6 

/z [ 2 — m] 




5 

4 

3 

2 

1 






2 

12 

h[ 3 — m] 





5 

4 

3 

2 

1 





3 

18 

/z [4 — m] 






5 

4 

3 

2 

1 




4 

24 

h [5 — m ] 







5 

4 

3 

2 

1 



5 

18 

h[ 6 — m] 








5 

4 

3 

2 

1 


6 

10 

h[l — m] 









5 

4 

3 

2 

1 

7 

0 


h[m] for different values of m. Following the steps involved in convolution, 
we generate the values for the sequence h[k — m] and store the value in a row. 
To generate the values of h[k — m ], we first form the function h[— m], which 
is obtained by time-inverting h[m\. The result is illustrated in the fourth row 
of Table 10.1. The time-reversed function h[—m] is used to generate h[k — m] 
by right-shifting /?[— m] by k time units. For example, the fifth row contains 
the values of the function h[— 1 — in] = h[—(m + 1)]. Similarly, rows (6)— ( 13) 
contain the values of the function h[k — m] = h[—(m — k)] for the range 0 
< k < 7. In order to calculate y [k] for a fixed value of k, we multiply the entries 
in the row containing x[m\ by the corresponding entries contained in the row 
for h[k — m] and then evaluate the summation: 

OO 

y[k] = x[m]h[k — m], 

m=—oo 

For k — —1, we note that the non-zero entries of x[m] and h[k — m] do not 
overlap. Therefore, y[k] = 0 for k = — 1. Since there is also no overlap for 
k < -1, the output y\k] = 0 for k < — 1. 

The aforementioned multiplication process is repeated for different values 
of k. For k — 0, we note that the only overlap between the non-zero values of 
x[m] and h[—m] occurs for m = 0. The output response is therefore given by 

>[ 0 ] = 2 - 1 = 2 . 

These values of time instant k = 0 and the output response y [0] = 2 are stored 
in the last two columns of row (6), corresponding to the entries of h[0 — in] 
in Table 10.1. Similarly, for k = 1, we observe that the overlap between the 
non-zero values of x[m ] and h[ 1 —m] occurs for m = 0 and 1. The output 
response is given by 


y[0] = 2-2 + 2- 1 = 6 
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Table 10.2. Convolution of x [/r] and /i [Ar] using the sliding tape method for Example 10.9 


m 

-5 -4 

-3 

-2 

-1 

0 

1 

2 

3 

4 

5 6 ... £ 

y[k] 

h [m ] 




3 

1 

-2 

3 

-2 




x \m ] 




-1 

1 

2 






x[—m] 




2 

1 

-1 






* 

1 

CO 

1 

3, 

2 

1 

-1 







-3 

0 

x[— 2 — m\ 


2 

1 

-1 






-2 

-3 

x[— 1 — m] 



2 

1 

-1 





-1 

2 

x[0 — m] 




2 

1 

-1 




0 

9 

x[l — m] 





2 

1 

-1 



1 

-3 

x[2 — m\ 






2 

1 

-1 


2 

1 

x[3 — m] 







2 

1 

-1 

3 

4 

x[4 — m\ 








2 

1 

-1 4 

-4 

x[5 — m] 









2 

1 -1 5 

0 


and is stored in the last column of Table 10.1. We repeat the process for increas- 
ing values of £ until the overlap between x [in] and h[k — m ] is eliminated. 
In Table 10.1, this occurs for k > 7, beyond which the output response y[k] is 
zero. 

By comparison with the result obtained in Example 10.7, we note that the 
output response y[£] obtained using the sliding tape method is identical to the 
one obtained using the graphical approach. 


Example 10.9 

For the following pair of the input sequence x\k | and impulse response h[k\. 


x[k] = 


k = - 1 
k = 0 
k = 1 
otherwise 


and h[k] = 


3 

1 

-2 

0 


£ = — 1,2 
k = 0 
£ = 1,3 
otherwise, 


calculate the output response using the sliding tape method. 


Solution 

The output y [£] can be calculated by convolving the input sequence x [£] with 
the impulse response /?[£]. Since convolution satisfies the distributive property, 
i.e. 


9 y[k] 

I 4 


2 

2 l 


-5-4-3 j-1 0 | 2 3 
-3 -3 


Fig. 10.8. Output response 
calculated using the sliding tape 
method in Example 10.9. 


y[£] = x[k] */?[£] = h[k] * jc[£]. 

Table 10.2 reverses the role of the input sequence x[k] with that of the impulse 
response h [£] and computes the following summation: 

OO 

y[£] = h[m]x[k — m], 

m=— co 

implying that the input sequence is time-reversed and time-shifted, while the 
impulse response is kept fixed. The results of Table 10.2 are plotted in Fig. 10.8. 
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10.6 Periodic convolution 


Linear convolution is used to convolve aperiodic sequences. If the convolv- 
ing sequences are periodic, the result of linear convolution is unbounded. In 
such cases, a second type of convolution, referred to as periodic or circular 
convolution, is generally used. 

Consider two periodic sequences A p [k] and h p [k], with identical fundamental 
period Kq. The subscript p denotes periodicity. The relationship for the periodic 
convolution between two periodic sequences is defined as follows: 


where the summation on the right-hand side of Eq. (10.15) is defined over 
one complete period Kq. In calculating the summation, we can, therefore, start 
from any arbitrary position (say m = ihq) as long as one complete period of 
the sequences is covered by the summation. For the lower limit m = mq, the 
upper limit is given by m = niQ + Kq— 1. In the text, the periodic convolu- 
tion is denoted by the operator ®, whereas the linear convolution is denoted 
by *. 

The steps involved in calculating the periodic convolution are given in the 
following algorithm. 


( 1 ) Sketch the waveform for input x p [m] by changing the independent vari- 
able of a p [A:] from k to m and keep the waveform for x p [m] fixed during 
steps (2)-(7). 

(2) Sketch the waveform for the impulse response h p [m ] by changing the inde- 
pendent variable from k to m . 

(3) Reflect h p [m] about the vertical axis to obtain the time-inverted impulse 
response h p [—m], Set the time index k = 0. 

(4) Shift the function h p [—m] by a selected value of k. The resulting sequence 
represents h p [k — m]. 

(5) Multiply input sequence x p [m] by h p [k — in] and plot the product function 
x p [m]h p [k — m], 

( 6 ) Calculate the summation 7 x p [m]h p [k — m] for m = [m q, ihq + 

Kq — 1] to determine y p [k] for the value of k selected in step (4). 

(7) Increment k by one and repeat steps (4)-(6) till all values of k in the specified 
range (0 < k < Kq — 1) are exhausted. 

( 8 ) Since v p [k] is periodic with period Kq, the values of y p [k] outside the range 
0 < k < Kq — 1 are determined from the values obtained in steps ( 6 ) and 

( 7 ). 



(10.15) 


m=(K 0 ) 


Algorithm 10.2 Graphical procedure for computing the periodic convolution 
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step (1) 

-.tfi.ni.ui- 

-4-3 -2-1 0 1 2 3 4 5 6 7 

step (4a) 


-4-3 -2-1 0 1 2 3 4 5 6 7 

step (4d) 








4 1 


A f 



" 4 l 

-4-3 -2-1 0 1 2 3 4 5 6 7 


Step (2) 5 5 h v l'n] 


-4-3 -2-1 0 1 2 3 4 5 6 7 

Step (4b) 




, t 


f T 


, t 

m 


1 | 


-4-4- 




—4-3 -2-1 0 1 2 3 4 5 6 7 
Step (7) T'pM 25 
15 15 

5 

JL 

0 12 3 


step (3) 


-4-3 -2-1 0 1 2 3 4 5 6 7 
Step (4C) x v [-m]h r [2-m] 

T 


4-t- 


T 

4-4- 


-4-3 -2-1 0 1 2 3 4 5 6 7 

Step (8) 


25 


25 


25 


15 15 

15 15 

15 15 













5 



5 



5 




JL 



JL 



JL 


• • ■ 


-4 -3 -2-1 0 1 2 3 4 5 6 7 


Fig. 10.9. Periodic convolution 
of the periodic sequences x[k] 
and h[k] in Example 10.10. 


By comparing the aforementioned procedure for computing the periodic con- 
volution with the procedure specified for evaluating the linear convolution in 
Section 10.5, we observe that steps (4), (6), and (7) are different in the two 
algorithms. In the linear convolution, the summation 

OO 

x[m]h[k — m] 

m=—o o 


is computed within the limits m = [— oo, oo] for different values of k in the 
range — oo < k < oo. In the periodic convolution, however, the summation is 
computed over one complete period, say m — [m o, m,Q + Kq — 1] for a reduced 
range (0 < k < K 0 — 1). 


Example 10.10 

Determine the periodic convolution between the following periodic sequences: 


x v [k] = k, for 0 < k < 3 and h v [k] = 
with the fundamental period Kq — 4. 


5 k = 0, 1 
0 £ = 2,3, 


Solution 

Following steps (1)— (3), the periodic sequences x p [m], h v [m], and its reflected 
version h v [—m] are plotted in Fig. 10.9, steps (l)-(3). Since the fundamental 
period Kq = 4, we compute the result of the periodic convolution as follows: 

3 

y p [k] = x p [£] <S> h v [k] = x p [m]hp[k — m ] (10.16) 

m= 0 

for 0 < k < 3. The DT periodic sequences h p [k — m ] and x p [m] for k = 0, 1, 
2, and 3 are plotted, respectively, in Fig. 10.9, steps 4(a)-(d). The convolution 
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summation, Eq. (10.16), has the following values: 

(k = 0) y p [0] = x p [0]/7 p [0] + JCp[l]* p [— 1] + x p [2]h p [-2] + x p [3]h p [-3] 

= 0x5+1 xO + 2xO + 3x5 = 15; 

(k= 1) y p m=x p [0]h p [l]+x p [l]h p [0]+x p [2]h p [-l] + x p [3]h p [-2] 

= 0x0+1 x5 + 2xO + 3xO = 5; 

(k = 2) >’ p [2] = x p [0]h p [2] + JCp[l]/» p [l] +x p [2]/z p [0] + x p [3]h p [-l] 

= 0x0+1x5 + 2x5 + 3x0=15; 

(k = 3) y p [3] = Jc p [0]Ap[3] + jc p [l]/ip[2] + JCp[2]A p [l] + x p [3]/7 p [0] 

= 0x0+1 x0 + 2x5 + 3x5 = 25. 

The remaining values of y p [£] are easily determined by exploiting the period- 
icity property of y p [A:]. The output y p [A:] is plotted in Fig. 10.9, step (8). 

An alternative procedure for computing the periodic convolution can be 
obtained by calculating the limits of Eq. (10.15) for m = 0 to m = Kq — 1. 
The resulting expression is given by 

*0-1 

ypOT = '^2, x p [m\h p [k - m] 


JpM = Xp[0]/z p [A:] + x p [l]h p [k - 1] + x p [2]h p [k - 2] 

+ ---+x p [K 0 -l]h p [k-(K 0 -l)], 

for 0 < k < Kq — 1 . Expanding the above equation in terms of the time index 
k yields 

y p [0] = x p [0]/i p [0] + JCp[l]A p [— 1] + x p [2]A p [-2] + ■ ■ ■ 

+ x p [Kq - l]h p [-(K 0 - 1)], 
y p [l] = x p [0]/! p [l] + x p [l]/7 p [0] + Xp[2]A p [-l] 

+ • • • + x p [^o - l]A P [-(^o - 2)], 

y P [2] = x p [0\h p [2] + x p [l]/7p[l] + x p [2]/7 p [0] + • • • 

+ Xp[A'o — 1 ] ^7 p [ ( Kq — 3)], 


V P [A 0 - 1] = Xp[0]/ip[^o - 1] + x p [l]/ip[^o - 2] 

+ x p [2\h p [Ko — 3] + • • • + x p [Kq — l]/7 p [0]. 

(10.17) 


Since /7 p [A:] is periodic, 


h p [k] = h p [k + /T 0 ] or h p [-k ] = h p [K 0 - k]. 


(10.18) 
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• \ m 

— • • ►i 

0 12 3 

(a) 


h M 


rCT 





— — • — 

1 

— ► 

0 1 2 
(b) 




i ApFO i 




• • 


— ► 


0 12 3 


(C) 


\[k] 



>■ k 


(d) 


V*- 1 ! 


Equation (10.18) is referred to as periodic or circular reflection. Before pro- 
ceeding with the alternative algorithm for periodic convolution, we explain 
circular reflection in more detail. 


Example 10.11 

For the periodic sequence 


h v [k] 


5 k = 0, 1 
0 k = 2, 3, 


with fundamental period Kq = 4, determine the circularly reflected sequence 
h p [—k] and the circular shifted sequence h p [k— 1]. 


Solution 

Let v p [£] denote the circular reflected sequence h p [— k). Using v p [&] = 
h p [—k] — /; p | Ko — k], the values of the circularly reflected signals are given 


by 


k = 0 

v P [0] = h p [K 0 ] = / lp [ 0] = 5; 

k = 1 

v P [l] = h p [K 0 - 1] = A p [3] = 0 

k = 2 

v p [2] = h p [K 0 - 2] = A p [2] = 0 

k = 3 

v P [3] = h p [K 0 - 3] = Ap[l] = 5 


The original sequence h p [k] is plotted in Fig. 10.10(a), and the circularly 
reflected sequence h p [—k] is plotted in Fig. 10.10(c). Note that the circu- 
larly reflected signal h p [— k] can be obtained directly from h p [k] by keep- 
ing the value of /i p [0] fixed and then reflecting the remaining values of 
h p [k] for 1 < k < Kq — 1 about k = Kq/2. This procedure is illustrated in 
Fig. 10.10(b). 

Substituting 0 < k < Kq — I , the values for the circularly shifted signal w p [k | 
= h p [k— 1 ] are obtained as follows: 


— * — — — * 

0 12 3 

(e) 

Fig. 10.10. Circular reflection 
and shifting for a periodic 
sequence, (a) Original periodic 
sequence h p [k], (b) Procedure 
to determine circularly reflected 
sequence h p [-k] from h v [k], 

(c) Circularly reflected sequence 
h p [-k\. (d) Procedure to 
determine circularly shifted 
sequence h p [k - 1] from h p [k], 
(e) Circularly shifted sequence 
h v [k - 1]. 


k = 0 

vp p [ 0] = A p [— 1] = AptA'o — 1] = 

k = 1 

vwp[l] = A p [0] = 5; 

k = 2 

v P [2] = A p [l] = 5; 

k = 3 

v P [3] = A p [2] = 0. 


The circularly shifted sequence h p [k — 1] is plotted in Fig. 10.10(e). The circu- 
larly shifted signal h p [k — 1] can also be obtained directly from h p [k] by shift- 
ing h p [k] towards the left by one time unit and moving the overflow value of 
h p [Ko — 1] back into the sequence. This procedure is illustrated in Fig. 10.10(d). 

To derive the alternative algorithm for periodic convolution, we substitute 
different values of k within the range 1 < k < Kq — 1 in Eq. (10.18). The 
resulting equations are given by 

M-l] = M^0 - 11; V— 2] = h p [K 0 - 2]; ... ; h p [-(K 0 - 1)] = A p [l], 
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which are substituted in Eq. (10.18) to obtain 

>’ P [0J = Jc p [0]A p [0] + x p [l\h p [K 0 - 1] + x p [2\h p [K 0 - 2] 

H Xp[^T 0 — 1]A P [1], 

y P [l] = Jc p [0]* p [l] + x p [l]/7 p [0] + Xp[2]h p [Ko ~ 1] 

+ ---x p [K 0 - l]* p [2], 

y p [2]= Xp [0]h p [2]+x p [l]h p [l] + x p [2]h p [0] + ---x p [K 0 -l]h p [3], 


y P [K 0 - 1] = x p [0]h p [K 0 - 1] + x p [l]h p [K 0 - 2] 

+ x p [2]h p [K 0 - 3] + • ■ • jc p [*o - 1]/Jp[0], 

(10.19) 

These expressions require values from only one period (0 < k < Kq — I) of 
the input sequence x p [k] and the impulse response h p [k]. Therefore, we can 
implement the periodic convolution from a single period of the convolving 
functions. The main steps involved in such an implementation are listed in the 
following algorithm. 


Algorithm 10.3 Alternative procedure for computing the periodic convolution 

(1) Sketch one period of the waveform for input x p [m ] by changing the inde- 
pendent variable of x p [k ] from k to m within the range 0 < k < Ko — 1. 

(2) Sketch one period of the waveform for the impulse response h p [m] by 
changing the independent variable from k to m within the range 0 < k < 
K 0 -\. 

(3) Reflect h p [m] such that h p [— m] — Ii p [Kq — m] as defined by the circular 
reflection. Set k = 0. 

(4) Using the circularly reflected function hJ—m], determine the waveform 
for h p [k — m] = h p [—(m — £)]. 

(5) Multiply the function x p [m] by h p [k — m] for 0 < m < Kq — 1 and plot 
the product function x p [m]h p [k — m], 

(6) Calculate the summation x p \m]h p [k — m] to determine y p [k] for 

the value of k selected in step (4). 

(7) Increment k by one and repeat steps (4)— (6) till all values of k within the 
range 0 < k < Kq — 1 are exhausted. 

(8) Since v p [k] is periodic with period Kq, the values of y p [k] outside the range 
0 < k < Kq — 1 are determined from the values obtained in steps (7). 

We illustrate the alternative implementation by repeating Example 10.12 and 

using the modified algorithm. 
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step (4c) 
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step (2) 
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step (4b) 
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step (4d) 




0 12 3 

* p [ m ]y3— m] 

f * 
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-► m 


0 12 3 


0 12 3 


Fig. 10.11. Periodic convolution 
using circular shifting in Example 
10 . 12 . 


steps (5)-(8) 


y P m 

25 25 25 



-4-3-2-101234567 


Example 10.12 

Using Algorithm 10.3, determine the periodic convolution of the periodic 
sequences 


Xp [k] = Jt (0 < k < 3) and h p [k] 


5 k = 0, 1 
0 k = 2, 3, 


with fundamental period Kq = 4. 


Solution 

Following steps (1) and (2), the applied input and the impulse response are 
plotted as a function of m in Fig. 10.1 1, steps (1) and (2). 

Following step (3), the circularly reflected impulse response v p [m] = 
hp[—m] — hp[Ko — in] for 0 < m < 3 is calculated as follows: 

v P [0] = A p [0] = 1; v p [l] = A P [— 1] = A P [3] = 0; v p [2] = /* p [— 2] 

= hp[2\ = 0; and v p [3] = A p [-3] = h p [ 1] = 3. 
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For k = 0, the DT sequence h v [k — m] = h p [—m], The value of the output 
response at k = 0 is given by 

*o-i 

y P [0] = XpMh p [-m] = 0(5) + 1(0) + 2(0) + 3(5) = 15. 

m = 0 

For k = 1, the DT sequence h p [k — m] = h p [\ — m). The new sequence 
h p [\ — ni ] = h p [—(m — 1)] is obtained by circularly shifting h p [—m] towards 
the right by one sample, with the last sample at m = 3 taking the place of the 
first sample at m = 0. The sequence /z p [l — m] is plotted in Fig. 10.11, step 
(4b). Multiplying by h p [m], the value of the output response at k = 1 is given 
by 

* 0-1 

y p [l] = x p [m\h p [\ - m] = 0(5) + 1(5) + 2(0) + 3(0) = 5. 

m= 0 

For k = 2, the DT sequence h p [k — m] — h p [ 2 — m]. The new sequence 
h p [2 — m ] is obtained by circularly shifting h p \ I — m] towards the right by 
one sample, with the last sample at m = 3 taking the place of the first sample at 
m — 0. The sequence /z p [2 — //;] is plotted in Fig. 10.1 1, step (4c). Multiplying 
by h p [m], the value of the output response at k — 2 is given by 
* 0-1 

y P [ 2] = J2 x vW h p[ 2 ~ m] = 0(0) + 1(5) + 2(5) + 3(0) = 15. 

m= 0 

For k = 3, the DT sequence li p [k — m] = h p [3 — ni). The new sequence 
h p [ 3 — m] is obtained by circularly shifting h p [ 2 — m] towards the right by 
one sample, with the last sample at m = 3 taking the place of the first sample at 
m — 0. The sequence h p 1 3 — m] is plotted in Fig. 10.1 1, step (4d). Multiplying 
by h p [m], the value of the output response at k = 3 is given by 
* 0-1 

y P l 3] = x p [m]h p [ 3 - m] = 0(0) + 1(0) + 2(5) + 3(5) = 25. 

m= 0 

The final output y p [A:], obtained from steps (5)— (8) of Algorithm 10.3, is 
plotted in Fig. 10. 1 1, Steps (5)-(8). Observe that the result is identical to that in 
Fig. 10.9, which was obtained using the full periodic convolution. 


10.6.1 Linear convolution through periodic convolution 

In this chapter, we have introduced two types of DT convolution. The linear 
convolution, defined in Eq. (10.14), is used to convolve aperiodic sequences, 
while the periodic convolution, defined in Eq. (10.15), is used for convolving 
periodic sequences. Definition 10.3 states a condition under which the results 
of the periodic and linear convolution are the same. 

Definition 10.3 Assume that x[k] and h[k] are two aperiodic DT sequences of 
finite length such that the following are true. 
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( i) The DT sequence x [£] = 0 outside the range kg\ < k <k u \. Note that it is 
possible for x[k] to have some zero values within the range k/\ <k<k u \. 
The length K x of x[k] is given by K x = ( k u \ — kg \ + 1) samples. 

(ii) The DT sequence h[k] = 0 outside the range kn <k< k u 2 . As for x[k), it 
is possible for h [&] to have intermittent zero values within the range kg 2 < 
k < k u 2 - The length Kh ofh[k] is given by K/, — k u 2 — kg 2 + 1 samples. 


Add the appropriate number of zeros to the two sequences x[k\ and h[k\ so 
that they have the same length Kq > ( K x + K/, — 1 ). The procedure of adding 
zeros to a sequence is referred to as zero padding. The periodic extensions of 
zero-padded x[k ] and h[k] are denoted by x p [A'] and h p [k], which have the 
same fundamental period of Kq > ( K x + Ki, — 1 ). Mathematically, the single 
periods of x p [k] and h p [k] are defined as follows: 

x p [k] = 

and 

h p [k] = 

It can be shown that the linear convolution between x[&] and h[k] can be 
obtained from the periodic convolution between x p [£] and h p [k] using the fol- 
lowing relationship: 


h[k] k t2 < k < k u2 

0 k u 2 < k < Kq + ka — 1 • 


(10.20b) 


(10.20a) 


x[k} * h[k] = x p [A:] ® h p [k]. 


for (kg 1 + k l2 ) <k< (k u i + k u2 ). 

Definition 10.3 provides us with an alternative algorithm for implementing 
the linear convolution through the periodic convolution. The advantage of the 
above approach lies in computationally efficient implementations of the peri- 
odic convolution, which are much faster than the implementations of the linear 
convolution. Chapter 12 presents one such approach using the discrete Fourier 
transform (DFT) to compute the periodic convolution. 

Algorithm 10.4 Computing linear convolution from periodic convolution 

(1) Consider two time-limited DT sequences x[k] and h[k]. The DT sequence 
x[k] = 0 outside the range kg\ < k < k u \ of length K x = k u \ — kg\ + 1 
samples. Similarly, the DT sequence h[k\ = 0 outside the range kg 2 <k < 
k u 2 of length K/, = k U 2 — kg 2 + 1 samples. 

(2) Select an arbitrary integer Kq > K x + K/,— 1. 

(3) Compute the periodic extension x p [k ] of x[k] using Eq. (10.20a). 

(4) Compute the periodic extension h p [k\ of /;[(' ] using Eq. 10.20b). 


447 


10 Time-domain analysis of DT systems 


Fig. 10.12. Periodic convolution 
using circular shifting in Example 
10.13. 


step (1) 


m 

2 

Tit- 


step (3) 

h[k] 

Jii. _,j, 

| M I I ► * lilt 

*-101* *0*23456 

-1 -1 -1 -1 


-t-t- 


step (4) 

*pW 

Jji, 

— 1 1 1 * t « t 

t-i 0 it 3 4 


-1 


-1 


step (5) 





(5) Calculate the periodic convolution y p [A' | = x p [A] ® h p [k], The result of 
the linear convolution is obtained by selecting the range ka + kn < k < 
k u \ + ku2 of y p [A | . 

Example 10.13 illustrates the aforementioned procedure. 


Example 10.13 

Compute the linear convolution of the following DT sequences: 

2 A = 0 

3 |*| = 1 
-1 |*|=2 

0 otherwise, 


2 k = 0 

x[k] = -1 |*| = 1 and h[k] 

0 otherwise 


using the periodic convolution method outlined in Algorithm 10.4. 


Solution 

The DT sequences x[A] and A|A] are plotted in Fig. 10.12, step (1). We observe 
that the length K x of x[A] is 3, while the length K/, of h[k] is 5. 

Based on step (2), the value of Kq > 3 + 5 — 1 or 7. We select Kq — 8. 

Following step (3), we form x p [A] by padding x[k] with Kq — K x or five 
zeros. The resulting sequence x p [A] is shown in Fig. 10.12, step (3). 

Following step (4), we form li p [k] by padding li[k\ with Kq — K/ ,, or three 
zeros. The resulting sequence /i p [A] is shown in Fig. 10.12, step (4). 

Following step (5), the periodic convolution of the DT sequences x p [A | and 
h p [k] is performed using the sliding tape method. The final result is shown 
in Table 10.3, where only one period (^fo = 8) of each sequence within the 
duration k = [—3, 4] is considered. 

The sliding tape approach illustrated in Table 10.3 is slightly different from 
that of Table 10.2. The reflection and shifting operations in Table 10.3 are 
based on circular reflection and circular shifting since periodic sequences are 
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Table 10.3. Periodic convolution of x p [k] and h p [k] in Example 10.13 


m 

-3 

-2 

-1 

0 

1 

2 

3 

4 

k >’p|C] 


h v [k ] 

0 

-1 

3 

2 

3 

-1 

0 

0 



x p [1] 

0 

0 

-1 

2 

-1 

0 

0 

0 



x p [ k] 

0 

0 

-1 

2 

-1 

0 

0 

0 



x p [— 4 - k ] 

-1 

0 

0 

0 

0 

0 

-1 

2 

-4 

0 

x p [— 3 - k] 

2 

-1 

0 

0 

0 

0 

0 

-1 

-3 

1 

x p [— 2 — k] 

-1 

2 

-1 

0 

0 

0 

0 

0 

-2 

-5 

x p [-l - k] 

0 

-1 

2 

-1 

0 

0 

0 

0 

-1 

5 

0 

1 

0 

0 

-1 

2 

-1 

0 

0 

0 

0 

-2 

x p [l - k ] 

0 

0 

0 

-1 

2 

-1 

0 

0 

1 

5 

x p [2 - k] 

0 

0 

0 

0 

-1 

2 

-1 

0 

2 

-5 

x p [3 - k] 

0 

0 

0 

0 

0 

-1 

2 

-1 

3 

1 

x p [4 - k] 

-1 

0 

0 

0 

0 

0 

-1 

2 

4 

0 


being convolved. The values of the output sequence y p [£] over one period 
(—3 < k < 4 ) are listed in the right-hand column of Table 10 . 3 . 

The plot of the periodic output y v \k] is sketched in Fig. 10 . 12 , step ( 5 ). 
The result of the linear convolution y[k] = x[k] * h[k] is obtained by selecting 
one period of the periodic output v p [A:] within the duration k f \ + ka. < k < 
kui + k u 2, which equals — 3 <k< 3 . 


10.7 Properties of the convolution sum 


The properties of the DT linear convolution sum are similar to the proper- 
ties of the CT convolution integral presented in Chapter 3 . In the following, 
we list the properties of linear convolution for DT sequences followed by the 
corresponding properties for the periodic convolution. 

Commutative property 

xi [k]*x 2 [k] = x 2 [k] * xdk]. (10.21) 

The commutative property states that the order of the convolution operands 
does not affect the result of the convolution. In the context of LTID systems, the 
commutative property implies that the input sequence and the impulse response 
of the DT system may be interchanged without affecting the output response. 
The periodic convolution also satisfies the commutative property provided that 
the two sequences have the same fundamental period K (l . 

Distributive property 


x\[k] * {x2[l] + X3M} = xi [A:] * X2[k~\ + xi|T] * X3 [k], ( 10 . 22 ) 
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The distributive property states that convolution is a linear operation with respect 
to addition. The periodic convolution also satisfies the distributive property 
provided that the three sequences have the same fundamental period Kq. 

Associative property 

xi [k] * [x 2 [k] * x 3 [k]} = {*![£] *x 2 [k]} *x 3 [k]. (10.23) 

This property states that changing the order of the linear convolution operands 
does not affect the result of the linear convolution. The periodic convolution 
also satisfies the associative property provided that the three sequences have 
the same fundamental period Kq. 

Shift property If x\[k] * X 2 [k] = g[fc], then 


Xl [k-ki]*x 2 [k-k 2 ] = g[k-h-k 2 ] (10.24) 

for any arbitrary integer constants k\ and Ai- In other words, if the two operands 
of the linear convolution sum are shifted then the result of the convolution sum 
is shifted in time by a duration that is the sum of the individual time shifts 
introduced in the operands. The periodic convolution satisfies the shift property 
with respect to the circular shift operation. 

Length of convolution Let the non-zero lengths of the convolution operands 
xi [A'] and xi [A:] be denoted by K i and Ki time units, respectively. It can be shown 
that the non-zero length of the linear convolution (xi [A] * X 2 M) is Ah + Ki — 1 
time units. The periodic convolution does not satisfy the length property. The 
circular convolution of two periodic sequences with fundamental period Kq is 
also of length Kq. 

Convolution with impulse function 

xi[k]*8[k-k 0 ] =xdk-k 0 ]. (10.25) 

In other words, convolving a DT sequence with a unit impulse function whose 
origin is located at k = ko shifts the DT sequence by ko time units. Since periodic 
convolution is defined in terms of periodic sequences and the impulse function 
is not a periodic sequence, Eq. (10.25) is not valid for the periodic convolution. 

Convolution with unit step function 

oo k 

x\ [A] * u[k] = x[m]u[k — m] = x[m\. (10.26) 

m=—c o m=—o o 

Equation (10.26) states that convolving a DT sequence x[k] with a unit step 
function produces the running sum of the original sequence x[k] as a function 
of time k. Since periodic convolution is defined in terms of periodic sequences 
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and the unit step function is not periodic, Eq. (10.26) is not valid for the periodic 
convolution. 

Causal functions If one of the sequences is causal, the expression for linear 
convolution, Eq. (10.14), can be written in a simpler form. For example, if 
h[k] = 0 for k < 0, the convolution sum y[£] in Eq. (10.14) is expressed as 
follows: 

OO 

y[k ] = x[k] * h[k] = h[m]x[k — m ] 

m=—oo 

OO 

= J2 h [m]x[k-m]. (10.27a) 

m= 0 

However, if h[k] is both causal and time-limited, i.e. if h[k] — 0 for k < 0 and 
k > K, then the convolution sum is expressed as follows: 

K 

y[k] = Y_ l h[m]x[k - m], (10.27b) 

m= 0 

Since periodic convolution is defined in terms of periodic sequences, which are 
not causal, Eqs. (10.27a) and (10.27b) are not valid for the periodic convolution. 

Example 10.14 

Simplify the following expressions using the properties of the discrete-time 
convolution: 

(i) (x[k] + 28[k- 1]) *«$[£- 2], 

(ii) (x[k - 1] - 3S[A: + 1]) * (8[k - 2] + u[k - 1]), 

where ,r[A:] is an arbitrary function and 8[k] is the unit impulse function. 

Solution 

(i) Applying the distributive property, 

(x[k] + 28[k- l])*S[A:-2] = x[k\ * 8[k - 2\ + 28[k - l]*8[k-2] . 

^ V ^ ^ ^ 

term I term II 

In both terms I and II, convolution with an impulse function is involved. 
Equation (10.25) yields 

term I = x[k] * 8[k — 2] = x[k — 2] 


and 


term II = 2 8[k - 1] * 8[k - 2] = 28[k - 3], 

The simplified expression for (i) is as follows: 

(x[k] + 28[k - 1]) * 8[k -2] = x[k - 2] + 2 S[k - 3]. 


451 


10 Time-domain analysis of DT systems 


(ii) Applying the distributive property, 

(x[k - 1] - 33 [it + 1]) * (5 [it - 2] + u[k - 1]) 

= x[k- 1] * &[k — 2] — 33[£ + 1] * 3[£ - 2] 

" v ' ' “v ' 

term I term II 

+ x[k- l]*u[k- l]-33[it+ l]*u[k- 1]. 

' s " V J K V" J 

term III term IV 

Terms I, II, and IV involve convolution with an impulse function. Equation 
(10.24) yields 

term I = x[k — 1] * S [k — 2] = x[k — 3], 
term II = 33[£ + 1] * 3 [it - 2] = 33 [it - 1], 

and 


term IV = 3S[k + 1] * u[k - 1] = 3u[k]. 

Term III involves convolution with a unit step function. We express term III as 
follows: 

term III = x[k - l]*u[k- 1] = (3 [it - 1] * x[Jt[) * (u[k] * 3 [it - 1]) 

= (jc[Jt] * u[k]) * (3 [it - 1] * S[k - 1]) = (jc[it] * u[k]) * 3 [it - 2], 

Using Eq. (10.26) we can further simplify term III to obtain 

term III = (x[k] * u[k]) * S[it - 2] = [ ^ x[m\ j * 3 [it - 2] 

\m =— oo / 

k—2 

= x[m]. 

rn=—o o 

The simplified expression for (ii) is given by 

(x\k - 1] - 33[A: + 1]) * (S[k - 2] + u[k - 1]) 

k—2 

= x[k - 3] - 3S[k - 1] + 3u[k] + X M- 


10.8 Impulse response of LTID systems 


In Section 2.2, we considered several properties of DT systems. Since the char- 
acteristics of an LTID system is completely specified by its impulse response, it 
is logical to assume that its properties can also be completely determined from 
its impulse response. In this section, we express some of the basic properties of 
the LTID systems defined in Section 2.2 in terms of the impulse response of the 
LTID systems. We consider the memory, causality, stability, and invertibility 
properties for the LTID systems. 


452 


Part III Discrete-time signals and systems 


10.8.1 Memoryless LTID systems 

A DT system is said to be memory less if its output y[A:] at time instant k = ko 
depends only on the value of the applied input sequence x [k ] at the same time 
instant k = ko. In other words, a memoryless LTID system typically has the 
input-output relationship of the following form: 

y[k] = ax[k \ , 

where a is a constant. By substituting x[k ] = S [&], the impulse response h[k] 
of a memoryless system can be expressed as 

h[k]=a8[k]. (10.28) 


An LTID system will be memoryless if and only if its impulse response 
h[k] = a!)\k]. Equivalently, an LTID system is memoryless if and only if 
h[k] = Ofor/fc ^ 0. 


10.8.2 Causal LTID systems 

A DT system is said to be causal if the output at time instant k — ko depends 
only on the value of the applied input sequence x[k ] at and before the time 
instant k = ko . Using the reasoning similar to that given in Section 3.7.2 for the 
CT system, the following can be stated. 


An LTID system will be causal if and only if its impulse response h [L] = 0 
for k < 0. 


10.8.3 Stable LTID systems 


A DT system is BIBO stable if an arbitrary bounded input sequence always 
produces a bounded output sequence. Consider a bounded sequence x[k ] with 
\x[k]\ < B x , for all k, applied as the input to an LTID system with impulse 
response h[k). The magnitude of the output _y[A' | is given by 


|y[*]| = 


oo 

h[m]x[k — m] . 

m =— oo 


Using the traingle inequality, we can say that the output is bounded by the 
following limit: 

OO 

\y[k]\< \h[m]\x[k-m]\. 

m =— oo 
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hm 

2 2 2 2 

-. T . T . T . T ... 

-5-4-3-2-1 0 1 2 3 4 5 

(a) 


h 2 [k] 


li 


-5-4-3-2-1 0 1 2 3 4 5 


Since \x[k]\ < B x , the above inequality reduces to 

oo 

\y[k]\<B x J2 \h[m]\. 

m=—c o 

It is clear from the above expression that for the output y[L| to be bounded 

E OO 

| /z [/7T ] | needs to be bounded. The 
stability condition can therefore be stated as follows. 


(b) 

5 

— +k 

—5 — 4 — 3 — 2 — 1 0 1 2 3 4 5 

(C) 

Fig. 10.13. Impulse responses 
for systems considered in 
Example 10.15. 

Example 10.15 

Determine which of the LTID systems with impulse responses, shown in 
Figs 10.13(a)-(c), are memoryless, causal, and stable. 


If the impulse response h[k] of an LTID system satisfies the following 
condition: 

OO 

X \h[k]\ < oo, (10.29) 

k=—o O 

the LTID system is BIBO stable. 


Solution 

(a) Memoryless: since hi[k] ^ 0 for k ^ 0, the DT system in Fig. 10.13(a) is 
not memory less. In fact, the impulse response h\[k] extends to — oo, therefore 
this system has an infinite memory. 

Causality: since h\[k] ^ 0 for all k < 0, the system is not causal. 

Stability: using Eq. (10.29), 

OO 2 2 

X imi = X i^mi = X 2 = °°- 

k=—o o k=— oo 

k=— oo 
k is even 


Therefore, the system is not stable. 

(b) Memoryless: since hlik) ^ 0 for k ^ 0, the DT system in Fig. 10.13(b) 
is not memoryless. The impulse response Ii 2 [k] has a finite memory of two time 
units. 

Causality: since h 2 [k] = 0 for all k < 0, the system is causal. 

Stability: using Eq. (10.29), 

OO 2 

X i^wi = Xi /i 2Wi = 3 + 2 + 1 = 6 - 

k=—oo k = 0 

Therefore, the system is BIBO stable. 

(c) Memoryless: since hj[k] = 0 for k ^ 0, the DT system in Fig. 10.13(c) 
is memoryless. 
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Causality: since h^[k] = 0 for all k < 0, the system is causal. Also note that 
all memoryless systems are causal. 

Stability using Eq. (10.29), 

OO 

l*s[*]l = l*3[0]| = 5. 

k = — oo 

Therefore, the system is BIBO stable. 


10.8.4 Invertible LTID systems 

Consider an LTID system with impulse response h[k]. The output yi [L| of the 
system for an input sequence jc [A:] is given by y \ [A:] = x [k] * h [£] . To check its 
invertibility property, we cascade a second LTID system with impulse response 
hi[k] in series with the original system. The output of the second system is 
given by 


y 2 [k] = yi [k] * hi[k] = (*[*] * h[k]) * hm 
= x[k]*(h[k]*hi[k]), 

based on the associative property. 

For the second system to be an inverse of the original system, the final output 
y 2 [k] should be the same as x[k], the input to the first LTID system. This is 
possible only if 


h[k] * hi[k] = S[k]. (10.30) 

The existence of hi[k] proves that an LTID system is invertible. At times, it is 
difficult to determine the inverse system h\[k] in the time domain. In Chapter 1 1 , 
when we introduce the discrete Fourier transform, we will revisit the topic and 
illustrate how the impulse response of the inverse system can be evaluated with 
relative ease in the frequency domain. 

Example 10.16 

Determine which of the following systems is invertible: 

(i) h[k] = «5[/fc-3]; 

(ii) h[k] = <$[£] + .$[£- 1], 

Solution 

(i) Because 8[k — 3] * S[k + 3] = <5[k], system (i) is invertible. The impulse 
response hi[k] of the inverse of system (i) is given by 

hi[k] = 8[k + 3], 

(ii) It is difficult to calculate the impulse response of the inverse system in 
the time domain. Using the DTFT introduced in Chapter 1 1, we can show that 
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the impulse response of the inverse of system (ii) is given by 

OO 

hi[k] = (-1 ) m S[k - m] = «$[£] - S[k - 1] + S[k - 2] - S[k - 3] ± • ■ ■ 

m=0 

We can show indirectly that h\k] is indeed the impulse response of the inverse 
of system (ii) by proving that h[k] * hi[k] = <$[&]: 

h[k ] * hi[k] = (£[£] + - 1]) * /?;[£] = h { [k ] + h { [k - 1] 

= (8[k] - S[k - 1] + S[k - 2] - S[k - 3] ± • • ■) + (<$[£ - 1] 

- S[k - 2] + S[k - 3] - 8[k - 4] ± • • •) 

= 

10.9 Experiments with Matlab 


M A T L A B provides several functions (also referred to as M-files) for processing 
DT signals and LTID systems. In this section, we will focus on the Matlab 
implementations of the difference equations with known ancillary conditions, 
convolution of two DT signals, and deconvolution. 

10.9.1 Difference equations 

Consider the following linear, constant-coefficient difference equation: 

y[k + n] + ci n -iy[k + n — 1] 4 h aoy[k] 

= b m x[k + m] + b m _\x[k + m — 1] + • • • + box[k], (10.31) 

which models the relationship between the input sequence x[k] and the output 
response y[k] of an LTID system. The ancillary conditions y[— 1], y[— 2], . . . , 
y[— n] are also specified. 

To solve the difference equation, Matlab provides a built-in function 
filter with the syntax 

» [yl = filter (B, A, X, Zi) ; 

In terms of the difference equation, Eq. (10.31), the input variables B and A are 
defined as follows: 

A = [1, a n ~i, . . . , a 0 ] and B = [b m , b m -\, . . . , b 0 ], 

while X is the vector containing the values of the input sequence and Zi denotes 
the initial conditions of the delays used to implement the difference equation. 
The initial conditions used by the filter function are not the past values of 
the output y[k ] but a modified version of these values. The initial conditions 
used by M A T L A B can be obtained by using another built-in function, f i 1 1 i c . 
The calling syntax for the f iltic function is as follows: 

» [Zi] = f iltic (B , A, yinitial ) ; 
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For an n -order difference equation, the input variable yinitial is set to 

yinitial = [y[-l], y[- 2], . . . , y[-n]\. 

To illustrate the usage of the built-in function filter, let us repeat 
Example 10.1 using Matlab. 

Example 10.17 

The DT sequence x[k ] = 2ku\k] is applied at the input of an LTID system 
described by the following difference equation: 

y[k+l]-0Ay[k]=x[k], 

with the ancillary condition y[— 1] = 4. Compute the output response y[k] of 
the LTID system for 0 < k <50 using Matlab. 

Solution 

The Matlab code used to solve the difference equation is listed below. The 
explanation follows each instruction in the form of comments. 


>> 

k = 

[0:50] ; 

% 

time index k = [-: 

1, 0, 





% . . .50] 


>> 

X = 

2 *k . * (k>=l) ; 

% 

Input signal 


>> 

A = 

[1 -0.4] ; 

% 

Coefficients with 

y [k] 

>> 

B = 

[0 1] ; 

% 

Coefficients with 

x[k] 

>> 

Zi : 

= f iltic (B, A, 4 ) ; 

% 

Initial condition 


>> 

Y = 

filter (B,A,X, Zi) ; 

% 

Calculate output 



The output response is stored in the vector Y. Printing the first six values of the 
output response yields 

Y = [1.6 0.6400 2.2560 4.9024 7.9610 11.1844], 

which corresponds to the values of the output response y[£] for the duration 
0 < k < 5. Comparing with the numerical solution obtained in Example 10.1, 
we observe that the two results are identical. 

Next we proceed with a second-order difference equation. 

Example 10.18 

The DT sequence x[k ] = 0.5 /; m[^] is applied at the input of an LTID system 
described by the following second-order difference equation: 

y[k + 2] + y[k + 1] + 0.25 y[k] = x[k + 2], 

with ancillary conditions y[— 1] = 1 and y [ — 2 1 = —2. Compute the output 
response y[k ] of the LTID system for 0 < k < 50 using Matlab. 
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Solution 

The Matlab code used to solve the difference equation is listed below. The 
explanation follows each instruction in the form of comments. 


>> 

k = 

[0:50] ; 

% 

time index k = [-: 

1, 0, 





% . . .50] 


>> 

X = 

0 . 5 . ~k . * (k>=0 ) ; 

% 

Input signal 


>> 

A = 

[1 1 0.25] ; 

% 

Coefficients with 

y[k] 

>> 

B = 

[1 0 0 ] ; 

% 

Coefficients with 

x [k] 

>> 

Zi = 

= filtic (B, A, [1 -2] ) ; 

% 

Initial condition 


>> 

Y = 

filter (B, A, X,Zi) ; 

% 

Calculate output 



The output response is stored in the vector Y. Printing the first five values of 
the output response yields 

Y = [0.5000 -0.2500 0.3750 -0.1875 0.1563 

-0 . 0781 0 . 0547] . 

To confirm if the Matlab code is correct, we also compute the values of 
the output response in the range 0 < k < 5. We express y[k + 2] + y[k + 1] + 
0.25 y[k~\=x[k + 2] as follows: 

y[k] = —y[k - 1] - 0.25y[& - 2] + x[k], 

with ancillary conditions y[— 1] = 1 and y[— 2] = —2. Solving the difference 
equation iteratively yields 

y[0] = — y[— 1] - 0.25y[— 2] + x[0] = -1 - 0.25(-2) + 1 = 0.5, 
y[ 1] = — y[0] — 0.25 y[ — 1 ] + a[1] = -0.5 - 0.25(1) + 0.5 = -0.25, 
y[ 2] = — y[l] - 0.25 v [0] + x[2] = -(-0.25) - 0.25(0.5) + 0.25 = 0.375, 
y[ 3] = -y[ 2] - 0.25y[l] + x[3] = -0.375 - 0.25(-0.25) + 0.125 
= -0.1875, 

y[ 4] = -y[ 3] - 0.25v[2] + x[4] = -(-0.1875) - 0.25(0.375) + 0.0625 
= 0.1563, 

and 

y[ 5] = -y[ 4] - 0.25y[3] + x[2] = -0.1563 - 0.25(-0.1875) + 0.031 25 
= -0.0782, 

which are the same as the values computed using Matlab . 

The expressions for the initial conditions for the higher-order difference equa- 
tions are more complex. Fortunately, most systems are causal with zero ancillary 
conditions. The initial conditions Zi are zero in such cases. 
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10.9.2 Convolution 


Consider two time-limited DT sequences xi[A:] and X2 [£], where x\[k\ ^ 0 
within the range kn < k < k u \ and X2 [k] ^ 0 within the range k^ < k < k U 2- 
The length K\ oftheDT sequence X| [k] is given by K \ —k u \ —kn + 1 samples, 
while the length K2 of the DT sequence xi [A: ] is Ki = k U 2 — ke 2 + 1 samples. 
In Matlab, two vectors are required to represent each DT signal. The first 
vector contains the sample values, while the second vector stores the time 
indices corresponding to the sample values. For example, the following DT 
sequence: 

-1 k =- 1 

x[k] - 1 * = ° 

X[kl ~ 2 k = \ 

0 otherwise 

has the following Matlab representation: 

>> kx =[-101]; % time indices where x is nonzero 

>> x = [-1 12]; % Sample values for DT sequence x 

To perform DT convolution, Matlab provides a built-in function conv. We 
illustrate its usage by repeating Example 10.9 with Matlab . 


Example 10.19 

Consider the following two DT sequences x[k] and h[k] specified in 
Example 10.9: 


x[k] = 


-1 k =- 1 

1 k = 0 

2 k = 1 

0 otherwise 


and h[k] = 


3 k = —1,2 
1 k = 0 
-2 £=1,3 
0 otherwise. 


Compute the convolution y[k] = x[k] * h[k] using Matlab. 


Solution 

The Matlab code used to convolve the two functions is given below. As 
before, the explanation follows each instruction in the form of comments. 


» kx = [-101]; 

» x = [-112]; 

» kh = [-10123] 
» h = [3 1-2 3 -2] 
>> y = conv(x,h); 


% time indices where x is nonzero 
% Sample values for DT sequence x 
% time indices where y is nonzero 
% Sample values for DT sequence y 
% Convolve x with h 


>> ky = kx ( 1 ) +kh ( 1 ): kx ( length (kx) ) +kh ( length (kh) ) 
% ky= time indices for y 


In the above instructions, note that Matlab does not calculate the indices of 
the result of convolution. These indices have to be calculated separately based 
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on the observation that we made on the starting and last indices of the convolved 
result. 

The computed values of y are given by 

y = [-3 2 9 -3 1 4 -4], 
with the computed indices 

ky = [-2-101234], 

Note that the above result is the same as the one obtained in Example 10.9. 

The function deconv performs the inverse of the convolution sum. Given a DT 
input sequence x and the output sequence y, for example, the impulse response 
h can be determined using the following instructions: 

>> h2 = deconv (y,x) ; % Deconvolve x out of y 

>> kh2 = ky ( 1 ) -kx ( 1 ): ky ( length (ky) ) -kx ( length (kx) ) ; 

% kh2 = indices for h2 

Note that h2 has the same sample values and indices kh2 as those of h. 


10.10 Summary 


In this chapter, we developed analytical techniques for LTID systems. We saw 
that the output sequence y[A'] of an LTID system can be calculated analytically 
in the time domain using two different methods. In Section 10.1, we determined 
the output of a DT system by solving a linear, constant-coefficient difference 
equation. The solution of such a difference equation can be expressed as a sum 
of two components: the zero-input response and the zero-state response. The 
zero-input response is the output produced by the DT system because of the 
initial conditions. For most DT systems, the zero-input response decays to zero 
with increasing time. The zero-state response results from the input sequence. 
The overall output of a DT system is the sum of the zero-input response and 
the zero-state response. A DT system, of the form shown in Eq. (10.1), will be 
an LTID system if all initial conditions are zero. In other words, the zero-input 
response of an LTID system is always zero. 

An alternative representation for determining the output of an LTID system 
is based on the impulse response of the system. In Section 10.3, we defined the 
impulse response h [A:] as the output of an LTID system when a unit impulse S [A:] 
is applied at the input of the system. In Section 10.4, we proved that the output 
y[k\ of an LTID system could be obtained by convolving the input sequence 
x[k\ with its impulse response h[k]. The resulting convolution sum can either 
be solved analytically or by using a graphical approach. The graphical approach 
was illustrated through several examples in Section 10.5. In discrete time, the 
convolution of two periodic functions is also defined and is known as periodic 
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or circular convolution. The periodic convolution is discussed in Section 10.6, 
where we mentioned that the linear convolution may be efficiently calculated 
through periodic convolution. The convolution sum satisfies the commutative, 
distributive, associative, and time-shifting properties. 

( 1 ) The commutative property states that the order of the convolution operands 
does not affect the result of the convolution. 

(2) The distributive property states that convolution is a linear operation with 
respect to addition. 

(3) The associative property is an extension of the commutative property to 
more than two convolution operands. It states that changing the order of 
the convolution operands does not affect the result of the convolution sum. 

(4) The time-shifting property states that if the two operands of the convolution 
sum are shifted in time then the result of the convolution sum is shifted 
by a duration that is the sum of the individual time shifts introduced in the 
convolution operands. 

(5) If the lengths of the two functions are K\ and Ki samples, the convolution 
sum of these two functions will have a length of K\ + Ki — 1 samples. 

(6) Convolving a sequence with a unit DT impulse function with the origin at 
k — ko shifts the sequence by h, time units. 

(7) Convolving a sequence with a unit DT step function produces the running 
sum of the original sequence as a function of time k. 

Finally, in Section 10.8, we expressed the memoryless, causality, stability, and 
invertibility properties of an LTID system in terms of its impulse response. 

(1) An LTID system will be memoryless if and only if its impulse response 
h[k] = 0 for k ± 0. 

(2) An LTID system will be causal if and only if its impulse response h [A:] = 0 
for k < 0. 

(3) The impulse response h[k] of a (BIBO) stable LTID system is absolutely 
summable, i.e. 

OO 

\h[k]\ < oo. 

k = — oo 

(4) An LTID system will be invertible if there exists another LTID system with 
impulse response hi[k] such that h[k] * h{[k] = <5[A]. The system with the 
impulse response lu[k] is the inverse system. 

In the next chapter, we consider the frequency representations of DT sequences 
and systems. 

Problems 


10.1 Consider the input sequence x [A] = 2 u [ A] applied to a DT system modeled 
with the following input-output relationship: 


y[k + 1] — 2y[k] — x[k], 
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and ancillary condition y[— 1] = 2. 

(a) Determine the response y [Ac } by iterating the difference equation for 
0<k<5. 

(b) Determine the zero-state response y z i[k] for 0 < k < 5. 

(c) Calculate the zero-input response y zs [Ac] for 0 < k < 5. 

(d) Verify that y[k] = y zi [k] + y zs [A']. 

10.2 Repeat Problem 10.1 for the applied input x[k ] = 0.5 A m [A: ] and the input- 
output relationship 

y[k + 2] - y[k + 1] + 0.5 y[k] = x[k], 
with ancillary conditions y[— 1] = 0 and v[— 2] = 1. 

10.3 Repeat Problem 10.1 for the applied input x[k \ = (— 1 ) k u[k] and the 
input-output relationship 

y[k + 2] - 0.75 y [A: + 1] + 0.125y[A'] = x[k], 


with ancillary conditions y [ — 1 ] = 1 and y [ — 2] = — 1. 


10.4 Show that the convolution of two sequences a k u[k] and b k u[k\ is given 
by 


(a k u[k])*(b k u[k]) 


(k + 1 )a k u[k] a—b 

—^—(a k+1 - b k+l )u[k] a^b. 
a—b 


10.5 Calculate the convolution (x\ [A:] * 
sequences: 

(a) x\[k] — u[k + 2] — u[k — 3], 

(b) Xl [k] = 0.5 k u[k], 

(c) xi[k] = l k u[—k + 2], 

(d) Xl [k] = 0.6 k u[k], 

(e) Xl [k] = 0.5 W , 


X 2 [k]) for the following pairs of 

x i[k] — u[k + 4] — u[k — 5]; 
x 2 [k] = 0.8 k u[k — 5]; 
x 2 [k] = 0.4 k u[k - 4]; 
x 2 [k] = sm{nk/2)u[— k]; 
x 2 [k] = 0 . 8 1 * 1 . 


10.6 


For the following pairs of sequences: 

k 0<k <3 ^ ^ = 


(a) x[k] = 


0 otherwise 

1*1 1*1 <2 
0 otherwise 
calculate the DT convolution y[k\ — x[k\ * h 
approach and (ii) the sliding tape method. 


(b) 4A:] = 


and /*[A'] = 


2 -1 < k < 2 
0 otherwise; 

2~ k 0 < k < 3 
0 otherwise, 

A:] using (i) the graphical 


10.7 Using the sliding tape method and the following equation: 

OO 

y[k\ = h[m]x[k — m], 

m = — oo 


calculate the convolution of the sequences in Example 10.8 and show that 
the convolution output is identical to that obtained in Example 10.8. 
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10.8 Using the sliding tape method and the following equation: 

OO 

y[k] = x[m]h[k — m], 

m=—o o 

calculate the convolution of the sequences in Example 10.9 and show 
that the convolution output is identical to that obtained in Example 10.9. 

10.9 The linear convolution between two sequences x[k ] and h[k] of lengths 
K\ and /if 2 , respectively, can be performed using periodic convolution by 
considering periodic extensions of the two zero-padded sequences. Cal- 
culate the linear convolution of the sequences defined in Example 10.8 
using the periodic convolution approach with the fundamental period 
Ko set to 10. Repeat for Kq set to 13. 

10.10 Repeat Example 10.7 using the periodic convolution approach with K 
set to 10. 

10.11 Repeat Example 10.7 using the periodic convolution approach with K 
set to 15. 

10.12 Repeat Example 10.12 with K set to 8. 

10.13 Calculate the unit step response of the DT systems with the following 
impulse responses: 

(a) h[k] = u[k + 7] - u[k - &]■, 

(b) h[k] = 0.4 k u[k]-, 

(c) h[k\ = 2 k u[-k]; 

(d) h[k] = 0.6 W ; 

OO 

(e) h[k] = Y (-l) m S(k-2m). 

m = — oo 

10.14 Simplify the following expressions using the properties of discrete-time 
convolution: 

(a) (x[/fc] + 2 S[k - 1]) * S[k - 2]; 

(b) (x[/fc] + 2 S[k - 1]) * (S[k + 1] + S[k - 2]); 

(c) (x[k\ - u[k - l]) * S[k - 2]- 

(d) (x[k\ -x[k- 1 ])*u[k], 

where x [A'] is an arbitrary function, H[k\ is the unit impulse function, and 
u [A:] is the unit step function. 

10.15 Prove Definition 10.3 by expanding the right-hand side of the periodic 
convolution and showing it to be equal to the left-hand side. 

10.16 Prove the time-shifting property stated in Eq. (10.24). 

10.17 Show that the linear convolution y \k \ of a time-limited DT sequence 
x\[k] that is non- zero only within the range k f \ < k < k u \ with another 
time-limited DT sequence X 2 [Ai] that is non-zero only within the range 
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k (_2 < k < k U 2 is time-limited, and is non-zero only within the range 
kn + ka. < k < k u i + k U 2 . 

10.18 For each of the following impulse responses, determine if the DT system 
is (i) memoryless; (ii) causal; and (iii) stable: 

(a) h[k] = u[k + 7] - u[k - $]; 

(b) h[k] = sin(^) u[k]\ 

(c) h[k] = 6 k u[-k]- 

(d) h[k] = 0.9 1 * 1 ; 

CO 

(e) h[k] = (-l) m 8(k-2rn). 


10.19 Determine which of the following pair of impulse responses correspond 


to inverse systems: 

(a) hi[k] = u[—k - 1], 

(b) h { [k] = 0.5 k u [k], 

(c) h { [k] = 0.8 k ku[k], 

(d) hi[k] = ku[k], 

(e) hdk] = (k +l)0.S k u[k], 


h 2 [k] = 8[k - 1] - S[k]; 
h 2 [k] = S[k]-0.5S[k - 1]; 
h 2 [k] = 0.8(5[£ - 1] - 2 8[k] 

+ l.25S[k+ 1]; 

h 2 [k] = S[k + 1] - 2S[k] + S[k - 1]; 
h 2 [k] =8[k]- 1.6 S[k- 1] 

+ 0.645[yt — 2]. 


10.20 Repeat Problems 10.1-10.3 to compute the first 50 samples of the out- 
put response using the filter and filtic functions available in 
Matlab. 


10.21 Repeat Problem 10.5 using the conv function available in Matlab. 
For a sequence with infinite length, you may truncate the sequence when 
the value of the sequence is less than 0.1% of its maximum value. 

10.22 The Matlab function impz can be used to determine the impulse 
response of an LTID system from its difference equation representation. 
Determine the first 50 samples of the impulse response of the LTID 
systems with the difference equations specified in Problems 10.1-10.3. 


CHAPTER 


Discrete-time Fourier series 
and transform 


In Chapter 10, we developed analysis techniques for LTID systems based on the 
convolution sum by representing the input sequence x [k] as a linear combination 
of time-shifted unit impulse functions. In this chapter, we introduce frequency- 
domain representations for DT sequences and LTID systems based on weighted 
superpositions of complex exponential functions. For periodic sequences, the 
resulting representation is referred to as the discrete-time Fourier series (DTFS), 
while for aperiodic sequences the representation is called the discrete-time 
Fourier transform (DTFT). We exploit the properties of the discrete-time Fourier 
series and Fourier transform to develop alternative techniques for analyzing DT 
sequences. The derivations of these results closely parallel the development of 
the CT Fourier series (CTFS) and CT Fourier transform (CTFT) as presented 
in Chapters 4 and 5. 

The organization of this chapter is as follows. In Section 11.1, we intro- 
duce the exponential form of the DTFS and illustrate the procedure used to 
calculate the DTFS coefficients through a series of examples. The DTFT pro- 
vides frequency representations for aperiodic sequences and is presented in 
Section 1 1.2. Section 1 1.3 defines the condition for the existence of the DTFT, 
and Section 11.4 extends the scope of the DTFT to represent periodic sequences. 
Section 11.5 lists the properties of the DTFT and DTFS, including the time- 
convolution property, which states that the convolution of two DT sequences 
in the time domain is equivalent to the multiplication of the DTFTs of the 
two sequences in the frequency domain. The convolution property provides 
us with an alternative technique to compute the output response of the LTID 
system. The DTFT of the impulse response is referred to as the transfer func- 
tion, which is covered in Section 11.6. Section 11.7 defines the magnitude and 
phase spectra for LTID systems, and Section 1 1.8 relates the CTFT and DTFT 
of periodic and aperiodic waveforms to each other. Finally, the chapter is con- 
cluded in Section 11.9 with a summary of important concepts covered in the 
chapter. 
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11.1 Discrete-time Fourier series 


In Example 4.4, we proved that the set of complex exponential functions 
exp(j«&>of), n e Z, defines an orthonormal set of functions over the interval 
t = (f 0 , tg + 7o) with duration Tq = 2jt /u>q. This orthonormal set of exponen- 
tials was used to derive the CT Fourier series. In the same spirit, we now show 
that the discrete-time (DT) complex exponential sequences form an orthonor- 
mal set in the DT domain and are used to derive the DTFS. We start with the 
definition of the orthonormal sequences. 

Definition 11.1 Two sequences p[k] and q[k] are said to be orthogonal over 
interval k = [k\, ^ 2 ] if 

k 2 k 2 

orthogonality property E = E = 0, p[k] ± q[k], 

*=fci k=h 

( 11 . 1 ) 

where the superscript * denotes complex conjugation. In addition to Eq. (11.1), 
both signals p[k] and q [&] must also satisfy the following unit magnitude prop- 
erty to satisfy the orthonormality condition: 

k 2 ' t'2 ' 

unit magnitude property E PWP*W = E 9*Wq[k] = 1. (11-2) 

k—k\ k—k\ 


Definition 11.2 A set comprising an arbitrary number of N functions, say {pi[k\, 
pi[k], ... , PN[k]}, is mutually orthogonal over interval k = [k\, ki\ if 


E 


k=k, 


Pmlk]p*[k] 


E„ 0 m = n 

0 m n. 


(11.3) 


for 1 < m, n < N. In addition, ifE n = [for all n, the orthogonal set is referred 
to as an orthonormal set. 


Based on Definitions 11.1 and 11.2, we show that the DT complex sequences 
form an orthogonal set. 


Proposition 11.1 The set of discrete-time complex exponential sequences 
{exp(jnJ2o&), n e Z), is orthogonal over the interval [r, r + Kq — 1], where 
the duration Kq = 2tt / I2q and r is an arbitrary integer. 


Proof 

Consider the following summation: 

r -\-Ko~ 1 

^]inQ Q k Q -)nQok 

k=r 


r+Ko-l 

E 


k=r 


e j (m-n)fi 0 k 
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Substituting p = k — r to make the lower limit of the summation equal to zero 
yields 


r+K 0 -l 

E 


e j(m-n)n 0 k 


*0-1 

E 


j(m-n)flo(p+r) 


— e j(m— n)ftor 


* 0-1 

e j(m-«)fio p 


k=r 


P = 0 


P—0 


The above summation is solved for two different cases, m — n and m ^ n. 

Case I For m = n, the summation reduces to 

ATo— 1 ATo— 1 


^ ){m— n)ftor E gj (m-n)Si 0 p 


i ■ E 1 = 


P = 0 


p =0 


Case II For m ^ n, the summation forms a GP series and is simplified as 
follows: 


* 0-1 

g j(m— «)r2 0 r ' gj(m-«)fi 0 p _ gj(m-n)J 2 0 r 

P = 0 


_ gj(m-«)12o*0 " 

1 _ e j(m-n)n 0 


Because QqKq — 2i r and indices m and n are integers, the exponential term in 
the numerator is given by 


gj(m— _ gj(m-n)27T _ 


Therefore, for m ^ n the summation reduces to 

*0-1 

gj(m— «)nor y ' gj(m-n)fioP _ gj(m-n)fi 0 r 
P = 0 

Combining the results of cases I and II, we obtain 

r + *0 — 1 p -r 

y' gjmfloig-jnflo* = K 0 it m = n 
0 if m n . 

k=r ' 

In other words, the set of DT complex exponential sequences {exp(jnl?ok), 
n e Z} is orthogonal over the specified interval [r. r + Ku — 1], 

An important difference between the DT and CT complex exponential functions 
lies in the frequency-periodicity property of the DT exponential sequences. 
Since 

c )rt(n 0 +2n)k _ gjnfl 0 A- gjn2jr«r _ & \nQ 0 k 

the exponential sequence expfjnGoA:) is identical to exp(j/;(l?o + 2: r)k). This 
is in contrast to the CT exponentials, where exp(j«oj () f ) is different from 
exp(jn(tt)o + 2jt)t). The following example illustrates the frequency period- 
icity for the DT sinusoidal signals. Using the Euler property, a DT complex 
exponential exp(jnf?oA:) can be expressed as follows: 

e jn(i 0 k _ cos ( n /2 0 ^) -)- j sin(nJ?o^). 


1 - 1 

l _ e j(m-n)«o 


= 0. 
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Example 11.1 shows that both the real and imaginary components of the com- 
plex exponential satisfy the frequency-periodicity property; therefore, the DT 
complex exponential should also satisfy the frequency-periodicity property. 

Example 11.1 

Consider a CT sinusoidal function with a fundamental frequency of 1 .4 Hz, i.e. 

x(t) = cos(2.87 xt + </>), 

where (/> is the constant phase. Sample the function with a sampling rate of 
1 sample/s and determine the fundamental frequency of the resulting DT 
sequence. 

Solution 

In the time domain, the DT sequence is obtained by sampling x(t ) at t — kT . 
Since the sampling interval T = Is, 

x[k ] = xikT) — cos(2.8 nk + </>), 

which is periodic with a period fl\ — 2.8tt radians/s. Because the CT signal x(t) 
is a sinusoid with a fundamental frequency of 1 .4 Hz, the minimum sampling 
rate, required to avoid aliasing, is given by 2.8 samples/s. Since the sampling 
rate of 1 samples/s is less than the Nyquist sampling rate, aliasing is introduced 
due to sampling. Based on Lemma 9.1, the reconstructed signal is given by 

y(t) = cos(27r(1.4 — l)t) = cos(0.87rt + </>). 

Substituting t — kT, the DT representation of the reconstructed signal is given 
by 


y[k ] = cos(0.87rA: + <p ), 

which is periodic with a period ftj_ = 0.87T radians/s. From the above analysis, it 
is clear that the DT sequences x[£] = cos(2.8tt& + (p) and y[£] = cos(0.8t rk + 
4>) are identical. This is because the difference in the fundamental frequencies fl\ 
and ft 2 is 2jt. 

Proposition 11.2 A discrete-time periodic function x \k ] with period Kq can be 
expressed as a superposition ofDT complex exponentials as follows: 

x[k]= A ,e in!2ok , (11.4) 

n=<Ko> 

where Qq is the fundamental frequency, given by fto = 2tt / Kq, and the discrete- 
time Fourier series (DTFS) coefficients D n for 1 < n < Kq are given by 

D n = ^~ T x[k]e~ in{!ok - (H.5) 

K ° k=(K 0 ) 
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In Eq. (1 1.5), the limit of k — (Kq) implies that the sum can be taken over any 
Kq consecutive samples of x[k]. Unless otherwise specified, we would consider 
the range 0 < k < Kq — 1 in our derivations. 


Proof 

To verify the DTFS, we expand the right-hand side of Eq. (1 1.4) by substituting 
the value of D n from Eq. (1 1.5). With Kq consecutive exponentials in the range 
0 < n < ko — 1, the resulting expression is given by 

ATo-l 

J2 D„e inn ° k 

n= 0 


= £ 

n = 0 


— Y] x[m]e J ' 


—jnf2om 


U nSJak 


K o tZo 


Interchanging the order of the summation yields 


K 0 -\ , K 0 -l 

£ D n e ,n!!ok =~Y x[m] 

n=0 K ° m = 0 


^0-1 

Q }nn 0 (k-m ) 

n= 0 


(11.6) 


From Proposition 1 1 . 1 , we have 


K 0 -\ 

£ j nSl 0 (k-m) 

n=0 


Kq if k — m 
0 if k ^ m . 


The right-hand side of Eq. (1 1.6) reduces to 


ATo-l 1 * 0-1 J 

Y D n e > nQ ° k = —Y x[m]K 0 8[m - k] = — K 0 x[k] = x[k], 

n=0 K 0 rn= 0 K ° 


and therefore proves Proposition 1 1.2. 


Examples 1 1.2-1 1.5 calculate the DTFS for selected DT periodic sequences. 


Example 11.2 

Determine the DTFS coefficients of the following periodic sequence: 


h[k] = 


1 

0 


\k\ < N 

N+l<k<K 0 -N-l, 


(11.7) 


with a fundamental period Kq > (2N + 1). 


Solution 

With Kq consecutive samples in the range — N < k < Ko — N — 1, Eq. (1 1.5) 
reduces to 


n 


— Y i 

K 0 M 


. Q-jnttok 


. K 0 -N-l 

+ Vo- Q~ inS1 ° k 

K 0 , = V + 1 


1 

Ko 


N 

e -jn^o k 

k=—N 


D, 
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Table 11.1. Values of D n for 0 < n < 9 in Example 11.2 


n 0 1 2 3 4 5 6789 

D n 0.300 0.262 0.162 0.038 -0.062 -0.100 -0.062 0.038 0.162 0.262 


Fig. 11.1. (a) DT periodic 
sequence h[k]; (b) its DTFS 
coefficients calculated in 
Example 11.2. 


h[k] 



(b) 


The summation represents a GP series and simplifies as follows: 


D„ - — 


1 

K 0 


J n(2 0 N 


1 

K~o 

1 

K~o 


J« VoN _ 


J _ e -j«fl 0 (2iV+l) 

1 _ e — jntfo 

a— j«r?o(2Ar+l)/2 p j/i rr 0 (2,V4- 1 J/2 p— j»r2o(-tV+l)/2 - 


2 ^V+1 

/IJ/Q 


ijn^o/2 g— ]tif2o/2 


sin ( -nl?o 


Substituting the value of the fundamental frequency Qq — 2n /K q yields 


D n - — 
Kq 


sin 


( 2N+1 

V Kq 


nic 


1 

Kq ' 


-njr 


( 11 - 8 ) 


which represents a DT sine function. 

As a special case, we plot the values of the coefficients D„ for N = I and 
Kq = 10 in Fig. 11.1. The expression for the DTFS coefficients is given by 

sin(0.3«7r) 
sin(0.1/i7r)J ’ 

with the values for 0 < n < 9 given in Table 11.1. 


D n = — 
10 
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The value of the DTFS coefficient Dq is calculated using L’Hopital’s rule as 
follows: 


Do 


lim — 

n—> 0 10 


sin(0.3n;r) 

sin(O.lnjr) 


= lim — 

n—>0 10 


(0.3jr)cos(0.3H7r) 

(0.1;r)cos(0.lH7r) 


= 0.3. 


In Fig. 1 1 . 1 (b), we observe that the DTFS coefficients are periodic with a period 
of 10, which is the same as the fundamental period of the original sequence 
h[k], One such period is highlighted in Fig. 1 1.1(b). 


11.1.1 Periodicity of DTFS coefficients 

In Example 1 1 .2, we noted that the DTFS coefficients D n of a periodic sequence 
are themselves periodic with a period of Kq. In Proposition 1 1.3, we show that 
this is true for any DT periodic sequence. 

Proposition 11.3 The DTFS coefficients D„ of a periodic sequence x[k], with a 
period of Kq, are themselves periodic with a period of Kq. In other words, 

D n = D n+mKo form e Z. (11.9) 


Proof 

By definition, the DTFS coefficients are expressed as follows: 

D n+ mK 0 = Y, x[k]e- i<n+mKf,)!>(,k 
K ° k=(K 0 ) 


1 

K~o 


Y x[k]e~i nn ° k e-i mr>oK ° k 

k={K 0 ) 


where the exponential term exp(— fnfioKok) — exp(— yhmtk) = 1. The above 
expression reduces to 


1 

D n +mK 0 — , , 
F-0 


Y X[k]&-' in!l0k , 

k=(K 0 ) 


which, by definition, is D n . 

In the following examples, we calculate the DTFS coefficients D n over one 
period (n — ( Kq )) and exploit the periodicity property to obtain the DTFS 
coefficients outside this range. 

Example 11.3 

Determine the DTFS coefficients of the periodic DT sequence j [ k \ with one 
fundamental period defined as 


x[k] = 0.5 k u[k], 0 < k < 14. 


( 11 . 10 ) 
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0.5 


^°. 25 0.13 


_1_ 


-20 -18 -16 -14 -12 -10 -8 -6 -4 -2 



Fig. 11.2. Periodic DT sequence 
defined in Example 11.3. 


Solution 

The DT sequence x[k ] is plotted in Fig. 1 1.2. Since its period Kq = 15, the 
fundamental frequency fig = 2jr/15. The DTFS coefficients D n are given by 


D 


n 


l 

15 


14 

0.5 k e~ inn ° k 

k = 0 


1 14 

— ^(0.5e' J ' ,fio /', 

^ k = 0 


which is a GP series that simplifies to 

1 1 - (0.5e-i” fi °) 15 1 1 - o.5 15 e-i 15,!fi ° 

" ~~ 15 ’ 1 - 0.5e-i" fi ° ~ 15 ’ 1 - 0.5e-i' !fi ° 


Since fi?o = 2 tt/ 15, the exponential term in the numerator, exp(— jl5«f?o) = 
exp(— j2«7r) = 1. Expanding the exponential term in the denominator as 
expf— jn l7o) = cos(nfio) — j sin(nflo), the DTFS coefficients are given by 

1 — 0.5 15 

0.5cos(nl2o) +j0.5 sin(«l7o) 

. ( 11 . 11 ) 

0.5cos(nl2o) +j0.5 sin(«l7o) 


1 

D„ = — ■ 


15 1 - 
1 

15 ’ T^" 


As the DTFS coefficients are complex, we determine the magnitude and phase 
of the coefficients as follows: 


magnitude 


phase 


1 

15 


1 


-/(T — 0.5 cos(/ 2 fi?o)) 2 + (0.5 sin(nfi?o)) 2 


1 

VI -25 — cos(«fi?o) 


( 11 . 12 ) 


<D„ 


— tan' 


0.5 sin(nGo) 

1 — 0.5 cos(nf2o) J 


(11.13) 


where f2g = 2tt/ 15. The magnitude and phase spectra of the DTFS coefficients 
are plotted in Figs. 1 1.3(a) and (b), in which one period of D n is highlighted by 
a shaded region. 


Example 11.4 

Determine the DTFS coefficients of the following periodic function: 


x[k] = Ae > ((2nm/N)k+e) , 


(11.14) 
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-20 -18 -16 -14 -12 -10 -8 -6 -4 -2 0 2 4 6 8 10 12 14 16 18 20 


(a) 


<D„ 


-14 -12 -10 -8 o . 


0.21 ■ 


0 2 4 6 o.i 




16 18 20 




1 t 1 1 T 



1 J— 9 



i-02T°-° 7 -6 -4 -2 1 



i-0 2T 007 8 10 12 14 



1-0.33 i 



.-0.33 


1-0.44 -0.36 i 


• -0.44 

-0.51 

-0.51 - 

3.51 



->« 


-20 -18 -16 


-0.33 

1-0.44 


( b ) 


Fig. 11.3. (a) Magnitude where the greatest common divisor between the fundamental period N and the 

spectrum and (b) phase integer constant m is one. 

spectrum of the DTFS 
coefficients in Example 11.3. 

Solution 

We first show that the DT sequence x[k] is periodic and determine its fundamen- 
tal period. It was mentioned in Proposition 1 . 1 that a DT complex exponential 
sequence x[£] = exp(j(f2o^ + 6)) is periodic if 2n / Qq is a rational number. In 
this case, 2jr / l?o = N/m, which is a rational number as m . K and N are all 
integers. In other words, the sequence x[k] is periodic. Using Eq. (1.8), the 
fundamental period of x[k\ is calculated to be 

Kq = (2n/f2 0 )p = pN/m , 

where p is the smallest integer that results in an integer value for Kq. Note 
that the fraction N/m represents a rational number, which cannot be reduced 
further since the greatest common divisor between m and N is given to be one. 
Selecting p — m , the fundamental period is obtained as Kq = N . 

To compute the DTFS coefficients, we express x[k] as follows: 

jc[Jt] = Ae i e e &° mk 


and compare this expression with Eq. (1 1.4). For 0 < n < Kq — 1, we observe 
that 


D 


n 


AeJ® if n = m 

0 if n ^ m . 


(11.15) 


As a special case, we consider A = 2, Kq = 6, m = 5, and 9 = n /4. The 
magnitude and phase spectra for the selected values are shown in Figs. 
11.4(a) and (b), where we have used the periodicity property of the DTFS 
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->« 


-20 -18 -16 -14 -12 -10 -8 -6 -4 -2 0 2 4 6 8 10 12 14 16 18 20 


(a) 


<D, 


n /4 


k !4 


n !4 


7T/4 


7t/4 


tt /4 


n ! 4 


-20 -18 -16 -14 -12 -10 -8 -6 -4 -2 0 2 4 6 


10 12 14 16 18 20 




(b) 


Fig. 11.4. (a) Magnitude 
spectrum and (b) phase 
spectrum of the DTFS 
coefficients in Example 11.4. 


coefficients to plot the values of the coefficients outside the duration 0 < n < 
(K 0 - 1). 

Substituting 9 = 0 in Example 1 1 .4 results in Corollary 11.1. 


Corollary 1 1.1 The DTFS coefficients corresponding to the complex exponential 
sequence x[A'] = A exp(j2jr/«A:/A'o) with the fundamental period Kq are given 
by 


O n = 


A if n = m, m ± Kq, m ± 2Kq, . . . 
0 elsewhere. 


(11.16) 


provided the greatest common divisor between the m and Kq is one. 


Example 11.5 

Determine the DTFS coefficients of the following sinusoidal sequence: 

( 27 rm \ 

k + Oj , (11.17) 

where the greatest common divisor between integers m and N is one. The phase 
component 9 is constant with respect to time. 


Solution 

Using Proposition 1 . 1 , it is straightforward to show that the sinusoidal sequence 
y[/c] is periodic with fundamental period Kq. The fundamental frequency is 
given by Qq = 2n / Kq. 
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Based on Eq. (1 1.5), and noting that l?o = 2ji/Kq, the DTFS coefficients are 
given by 


D 


n 


— B sia(mn 0 k + 9) ■ e~ jnn ° k 

^0 k=<K 0 > 


1 

K~o 


E 


B 


e j (mflok+6) _ & ](mQok+6) - 

—J . 


. e -)n!2 0 k 


B 


i—e' e y 

2 K r 


a j (m-n)l2ak 


B 


k=(K 0 ) 


j— e -* y 

J 2 K r L -> 


^-i(m+n)fl 0 k 


k={K 0 ) 


summation I 


summation II 


In proving Proposition 1 1.2, we used the following summation: 


K 0 -l 

e jn!2o(k-m) 

n~0 


Kq if k — m 
0 if k ^ m . 


Therefore, summations I and II are given by 


E 

k=(K 0 ) 


gj(m-n)« 0 £ 


Kq if n — m 
0 if n ^ m ; 


n= E 

k=(K 0 ) 


-j(m+n)n 0 k _ 


K 0 

0 


if n = —m 
if n ^ —m , 


which results in the following values for the DTFS coefficients: 


D 


n 


B ifl 

-j-e J 
J 2 


B 

j— e 
J 2 


-]e 


for n = m 


for n = —m 
elsewhere. 


(11.18) 


within one period (— m < n < (Kq — m — 1)). 

As a special case, let us consider the DTFS for the following discrete sinu- 
soidal sequence: 

(2n 7 r \ 

y[k] = 3 sin! — k + — j, 


which has a fundamental period of Kq = 7. Substituting B = 3, m = 1, and 
9 = 7t/ 4 into Eq. (1 1.18), we obtain 


3 


— j-e J 4 
J 2 

for n = 1 

3 :E. 


j-e J 4 
J 2 

for u — — 1 

0 

elsewhere. 


(11.19) 


for — 1 < n < 5. The magnitude and phase spectra for the sinusoidal sequence 
are shown in Figs. 1 1.5(a) and (b). 
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\ D n\ 

1.5 

1.5 

1.5 

1.5 
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1.5 1.5 
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-12 
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-f 

-e 

-4 

-2 

0 

2 

4 

6 

8 

10 

12 14 

16 

18 ' 2 

0 


(a) 


<D 


n 


k/4 


k/4 


K/4 


k/4 


k/4 


k/4 


' -20 -6 8 


# • # * • 

* ■»-*■ 1 « 





-18 -16 -14 

-12 -10 -8 

-4-2 0 

2 4 6 


10 12 14 


-k/4 -k/4 -k/4 -k/4 -k/4 -k/4 




20 


(b) 


Fig. 11.5. (a) Magnitude 
spectrum and (b) phase 
spectrum of the DTFS 
coefficients in Example 11.5. 


Corollary 11.2 The DTFS coefficients of the sinusoidal sequence x[k] = B 
sin(27T mkt K q) are given by 



j 2 

for n = m , m ± Kq 

m zb 2K $, . . . 


D„ = 

. B 
% 

for n = —m, —m ± 

Kq, — m =b 2Kq, . . . 

(11.20) 


0 

elsewhere, 




provided that the greatest common divisor between integers m and Kq is one. 


11.2 Fourier transform for aperiodic functions 


In Section 11.1, we used the exponential DTFS to derive the frequency repre- 
sentations for periodic sequences. In this section, we consider the frequency 
representations for aperiodic sequences. The resulting representation is called 
the DT Fourier transform (DTFT). 

Figure 11.6(a) shows the waveform of an aperiodic sequence x[k], which 
is zero outside the range M\ < k < M 2 . Such a sequence is referred to as a 
time-limited sequence having a length of M 2 — M\ + 1 samples. As was the 
case for the CTFT, we consider periodic repetitions of x[k ] uniformly spaced 
with a duration of Kq between each other; Kq > (M 2 — M 1 + 1) such that the 
adjacent replicas of x [&] do not overlap with each other. The resulting sequence 
is referred to as the periodic extension of x[k ] and is denoted by XK 0 [k]. If we 
increase the value of Kq, in the limit, we obtain 

lim x Ko [k]=x[k]. 

Kq^OO 


( 11 . 21 ) 
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Fig. 11.6. (a) Time-limited 
sequence x[k]; (b) its periodic 
extension. 


m 


II 


-► k 


(a) 


M] 0 M 7 


%[*] 


II 


II 


II 




M, 0 M-, 


(b) 


Since xk 0 [A:] is periodic with fundamental period Kq (or fundamental frequency 
12 q), we can express it using the DTFS as follows: 


x Ko lk]= 

i,=(K 0 ) 


where the DTFS coefficients D„ are given by 


D 


n 


l 

K~o 


£ XK 0 [k]e- ]nn ° k , 

k=(K 0 ) 


( 11 . 22 ) 


for 1 < n < Kq. Using Eq. (11.21), the above equation can be expressed as 
follows: 


1 OO 

D n = lim — V jc[*)e- ]nS1 ° k (11.23) 

K °^°° K " k^oo 

for 1 < n < Kq. Let us now define a new function X(Q). which is continuous 
with respect to the independent variable 12: 

OO 

X(f2) = £ x[k]e~' iQk . (11.24) 

k — — oo 

In Eq. (11.24), the independent variable 12 is continuous in the range — oo < 
12 < oo. In terms of X(12), Eq. (11.23) can be expressed as follows: 

D„ = lim I-X(nl2 0 ). (11.25) 

A'o^-oo Kq 

The function X(nl2 o)is obtained by sampling X(12) at discrete points 12 = n T2 0 . 

Given the DTFS coefficients D n of x Ko [k], the aperiodic sequence x[k] can 
be obtained by substituting the values of D„ in Eq. (11.22) and solving for 
Mi < k < Mi_. The resulting expression is given by 

x[k] = lim x Ko [k] = lim V —X(nQ 0 )e inn ° k . 

Karroo ATo-i-oo Kq 

n={K 0 ) 


(11.26a) 
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In the limit Kq —>■ oo, the angular frequency l7o takes a very small value, 
say A 17, with the fundamental period Kq — 2n / A. fi. In the limit Kq —*■ oo, 
Eq. (1 1.26a) can, therefore, be expressed as follows: 


x[k ] = lim 

n=(K 0 ) 


— X(nAD)e> nkAn AD. 

2 7T 


(11.26b) 


Substituting Q = n A 12 and applying the limit A <1 — > 0, Eq. (1 1.26b) reduces 
to the following integral: 

*[£] = — [ X(C)e j “d«. (11.27) 

27 r J 

<2jt) 


In Eq. (11.27), the limits of integration are derived by evaluating the duration 
n — (Kq) in terms of 17 as follows: 


17 = (n A 17) !„=(*„) = 



= (27 r>, 

n=(K 0 ) 


implying that any frequency range of 2it may be used to solve the integral in 
Eq. (11.27). Collectively, Eq. (11.24), in conjunction with Eq. (11.27), is 
referred to as the DTFT pair. 


Definition 11.3 The DTFT pair for an aperiodic sequence x | k ] is given by 

DTFT synthesis equation x[k] = — /' A(f7)e J<f hll7; (11.28a) 

2it J 


(2jt) 


DTFT analysis equation X(Q) = x[k]e 


— j fik 


(11.28b) 


k = — oo 


In the subsequent discussion, we will denote the DTFT pair as follows: 

x[k] < DTFT > X(Q). (11.28c) 


Example 11.6 

Calculate the Fourier transform of the following functions: 


(i) unit impulse sequence, xi[k] = 5[k]; 

k 

(ii) gate sequence, X 2 [k] = recti 


\k\ < N 
elsewhere; 


S 2N+ 1, 

(iii) decaying exponential sequence, x^[k] = p k u[k ] with \p\ < 1. 


Solution 

(i) By definition, 

OO 

z,(c) = m^ nk = e- jm k =0 = 1. 

k=—o o 
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x 2 [k\ 



1 

1 

1 


-10 ’-8 -6 -4 

-2 

0 

2 

4 ' 6 

8 10 



(a) 


(b) 


Fig. 11.7. (a) Rectangular 
sequence x 2 [k] with a width of 
seven samples, (b) DTFT of the 
rectangular sequence derived in 
Example 11.6(ii). 


(ii) By definition, 


OO N 

X 2 (0) = 1 ' e_jM - 

k = — oo k=—N 

The summation represents a GP series with exp(— jl7) as the ratio between two 
consecutive terms. The GP series simplifies to 


X 2 (n) = (e~ in r N 
= (e- jw ) 


1 _ ( e -j«)2At+l 

1 — e - i fi 

■ n N ( e -l «)( 2 tV+t)/2 ( - e -jft-j-(2V+l)/2 _ (e - j « ) (2V+l)/2 


(e”i 


i^) — 1/2 — jn^t/2 

'2N+ 1 


e j(2A'+l)fi/2 _ e — j(2iV— 1)«/2 


sin 


-n 


gj^/2 


*—]Q/2 


sin - 17 
.2 


As a special case, we assume N — 3 and plot the rectangular sequence [A' ] 
and its DTFT X 2 (C2) in Fig. 11.7. 

(iii) By definition, 

OO OO 

Z 3 (G) = AWe“ jm = X!(pe _jn )*. 

k=—o o A:=0 


The summation represents a GP series, which can be simplified to 

1 1 

A 3 (G) = 


1 — per 1 — p cos 17 + jp sin 17 

The DTFT X 3 (17) is a complex-valued function of the angular frequency 17. Its 
magnitude and phase spectra are determined below: 

111 


magnitude spectrum 


phase spectrum 


\x,m = 


1 — p cos 17 + ]p sin 17 1 

1 


■J 1 — 2p cos 17+ p 2 

<X 3 (17) = <1 — <(1 — p cos 17 + )p sin 17) 


= — tan 


p sin 17 
1 — p cos 17 
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-10 -8 -6 -4 -2 

(a) 


Fig. 11.8. (a) Decaying 
exponential sequence x-i[k] 
with a decay factor p = 0.6. 

(b) Magnitude spectrum and 

(c) phase spectrum of Xi[k] as 
derived in Example 11.6(iii). 




As a special case, we plot the DT sequence X3 [k | and its magnitude and phase 
spectra for p — 0.6 in Figs. 1 1.8(a)-(c). 


In Example 11.6, we calculated the DTFTs for three different sequences and 
observed that all three DTFTs are periodic with period Qq — 2: r. This property 
is referred to as the frequency-periodicity property and is satisfied by all DTFTs. 
In Section 11.4, we present a mathematical proof verifying the frequency- 
periodicity property. 

Example 11.7 

Calculate the DT sequences for the following DTFTs: 

OO 

(i) — 2n <5(1? — 2 wi 7 t); 

m = — 00 
OO 

(ii) X 2 (1?) = 2tt <5(1? — l?o — 2 mn). 

m = — 00 


Solution 

(i) Using the synthesis equation, Eq. (11.28a), the inverse DTFT of X\(Q) is 
given by 


x\[k] = — 

2,71 


7T ^ 

- f Zi(f?)e j “dC= — f 2n &{^-2m7x)^ kn dQ 

\i) 2lX -2n m= -°° 


71 

/ OO 

E 

m — — 00 

— 71 
7 Z 

/ OO 


8(f2 - 2m7x)^ klmn dl? [•/ &{fi - 9)f{Q) = <5(1? - 6)f(9)] 


= 1 


5(i7 — 2mn)dQ. 
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The integral on the right-hand side of the above equation includes several 
impulse functions located at f2 = 0, ±2jr, ±4;r, . . . Only the impulse function 
located at 12 = 0 falls in the frequency range 12 = [— n, tt ] . Therefore, x\[k ] 
can be simplified as follows: 

71 

Xl [k] = J s(tt)dn= l. 

—71 

(ii) Using the synthesis equation, (11.28a), the inverse DTFT of 20(12) is 
given by 

71 

1 r i r 00 

Xi [k] = — / 20(l2)e jAfi dl2 = — / 2tt V 5(12 - f2 0 - 2mn)e, ]kn dQ. 
2n J 2 tv J L — ' 

J m=—o o 

(2^-) — tt 

7T 

/ oo 

^ S(n - 12 0 - 2m7r)e ii ' w> - 2 " OT) dU 

m=—c o 

—71 

71 

/ OO 

^ 5(12 - 12 0 - 2mjr)e i “° d!2 

m— — rv~i 


= 1 


_ 


71 

/ OO 

u 

m = — rv 


5(12 — 12q — 2mjr)d!2. 


The integral on the right-hand side of the above equation includes several 
impulse functions located at 12 = l2o + 2m n. Only one of these infinite num- 
ber of impulse functions will be present in the frequency range 12 = [— n, n]. 
Therefore, the integral will have a vaue of unity and the function X 2 [&] can be 
simplified as follows: 

x 2 [k] = e kn \ 


Table 1 1.2 lists the DTFT and DTFS representations for several DT sequences. 
In situations where a DT sequence is aperiodic, the DTFS representation is 
not possible and therefore not included in the table. The DTFT of the peri- 
odic sequences is determined from its DTFS representation and is covered in 
Section 1 1.4. 

Table 1 1.3 plots the DTFT for several DT sequences. In situations where a 
DT sequence or its DTFT is complex, we plot both the magnitude and phase 
components. The magnitude component is shown using a bold line, and the 
phase component is shown using a dashed line. 

Example 11.7 illustrates the calculation of a DT function from its DTFT 
using Eq. (11.28a). In many cases, it may be easier to calculate a DT 
function from its DTFT using the partial fraction expansion and the DTFT 
pairs listed in Table 11.2. This procedure is explained in more detail in 
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Table 11.2. DTFTs and DTFSs for elementary DT sequences 
Note that the DTFS does not exist for aperiodic sequences 


Sequence: x[k] 


DTFS: D„ 


1 

K~o 


J2 x[k]e-i nSi ° k 

k={K 0 ) 


oo 

DTFT: X(n) = x[k]e~ ink 

k=— oo 


( 1 ) x[k] = 1 


A, = 1 


OO 

X(f?) = 2n 5(22 — 2mn) 


(2) x[k] = &\k] does not exist 

(3) x[k\ = S[k — k 0 ] does not exist 

OO J 

(4) x[k}= V S(k-mK 0 ) D„ = — for all n 

m=- oo K 0 

(5) x[k\ = u[k\ does not exist 

(6) x[k\ = p k u[k\ with |p| < 1 does not exist 


(7) First-order time-rising 
decaying exponential 

x[k ] = (k + 1 )p k u[k], with 

Ipl < 1. 

(8) Complex exponential 
(periodic) 

x[k] = 

K 0 = 2jrp/n 0 


does not exist 


{ 1 n = p ± rK 0 

0 elsewhere 
for —oo < r < oo 


(9) Complex exponential does not exist 

(aperiodic) 

x[k\ = el* fi °, 2n/Q 0 ± 
rational 


(10) Cosine (periodic) 
x[k ] = cos(22o k) 
K 0 = 2np/Q 0 


A, = 


for 


1 

- n = ±p ± r K 0 

0 elsewhere 
— oo < r < oo 


(11) Cosine (aperiodic) does not exist 

x[k ] = cos(22 0 £), 

2jr/22 0 ^ rational 


(12) Sine (periodic) 
x[fe] = sin(i?o£) 

AT 0 = 2np/n 0 


A, = 


for 


I ^j n = ±p±rATo 

0 elsewhere 
—oo < r < o o 


(13) Sine (aperiodic) does not exist 

x[fe] = sin(i?o£), 

2jr/i?o ^ rational 


2m 7r \ 


X(22) = 1 
X(22) = 

OO 

x{si)=Y £ a ( fl - 

0 m=—oo \ 

OO ] 

X(fi) = n y"' <5(J? — 2m7r) H 

1 - 1 

*(A = 7 — 

1 — pe _ J J/ 

1 

X(22) = — 

(1 — per> n ) 2 


-j/2 


oo 

2f(22) = 27r 5(12 — 22o — 2m7r) 

m=—oo 


oo 

2f(22) = 27r 5(12 — 22 0 — 2mn) 

m =— oo 


2f(22) = 5(12 + J2o — 2mjr) 

m =— oo 
oo 

+ n <5(22 — i2 0 — 2m?r) 

m=—oo 

oo 

2f(i2) = 7r 5(22 + 22 0 — 2mn) 

m=—oo 

oo 

+ 7r 5(J2 — 22o — 2m?r) 

m=—oo 


X(O) = ]: r 5 ( 22 + 22o — 2m^) 

m =— oo 
oo 

— j7r 5(22 — 22 0 — 2m7r) 

/«=— OO 


2f(22) = j7r 5(22 + 22 0 — 2m7r) 

m = — oo 
oo 

-jjf E 5(22 — 22 0 — 2m7r) 

m =— oo 


(cont.) 
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Table 11.2. ( cont .) 


Sequence: x[k\ 


DTFS: D n = — V *Me 

Ko k=(K 0 ) 


-j n Qq k 


DTFT: X(tt) = -*W e 


— jiTfe 


(14) Rectangular (periodic) 

} 1 |£| < N 
[0 N < \k\ < K 0 /2 
x[k]=x[k + A) 0 ] 


x[k] = 


(15) Rectangular (aperiodic) 
"|1 \k\ < N 


x\k\ = 


0 elsewhere 


(16) Sine 

W (Wk\ 

x\k] = — sincl = 

jr \ n J 

sin(lVfc) 

for 0 < W < n 

nk 


D„ = 


sin (^^-nn 


°L sin (i K7r ) _ 


(2N + l)/ATo k = rlfo *(fl) = 2tt £ ( rt - — 




elsewhere 


does not exist 


does not exist 


(17) Arbitrary periodic sequence D„ = — YJ x[k]e ^ 

A'p 


-jn(2ok 


with period K 0 
x\k] = D„e in(!ok 

n={Ko) 


0 k=(K 0 ) 


'2 N + 1 
sin I n 


X{Q) = 


X{Q) = 


sin ( - ft 


1 |12| < W 


jo w<\n\<n 

X(ft) = X(ft + 2?r) 


A(f2) = 27r Y] A,S(/2 

' K a 


2 mt 


Appendix D, and has been used later in this chapter in solving Examples 11.15 
and 11.18. 


11.3 Existence of the DTFT 


Definition 11.4 The DTFT X(f>) of a DT sequence x | k \ is said to exist if 


|X(f?)| < oo, for — oo < FI < oo. (11.29) 


The above definition for the existence of the DTFT satisfies our intuition that 
a valid function should be finite for all values of the independent variable. 
Substituting the value of the DTFT X(f2) from Eq. (11.28b), Eq. (11.29) can 
be expressed as follows: 


OO 

x[k]e~ ink 

k = — oo 


< OO, 


which is satisfied if 

OO 

k =— oo 


< OO. 


Table 11 . 3 . DTFT spectra for elementary DT sequences 


Sequence 


Time-domain waveform 


Magnitude and phase spectra 


(1) Constant 
x[k] = 1 


(2) Unit impulse 
x[k] = <5 [At] 


(3) Unit step 
x[k] = u[k] 


(4) Decaying exponential 
x[k ] — p k u[k] 
with \p\ < 1 


(5) Rectangular 

[1 \k\<N 


m = i 

i 


-6 -4 -2 0 2 4 6 


-> k 


xm=m 

i 


-6 -4 -2 0 2 4 6 

x[k] = u[k] 


* k 


-6 -4 -2 0 2 4 6 


x[k] = p k u[k ] 


lit. . 'I,' 


-6 -4 -2 0 2 4 6 


X[k] = 




1 |/c| < N 
0 elsewhere 


0 elsewhere 




► k 


(6) First-order time-rising 
decaying exponential 
x[k] = (k + 1 )p k u[k] 
with \p\ < 1 


(7) Sine 

x[k] = —sine ( 

n \ n ) 


(8) Complex exponential 
x[k] = e, ikS2a 


-NON 


4k\ = (k + \)p u[k] 


1 2 p 


3 P 2 


T T T T ► 


-6 -4 -2 0 2 4 6 




(9) Cosine 

jr[A'] = cos(Uo^) 



Jr(fl) = 27 i£<5(C2-2»ot) 

—I — I — I — I — I — I 1-> O 

-6n -4n -2 k 0 2 n 4n 6 n 

x(n)=\ 

i 


► n 


-3n -2n -k 0 n In 3 n 

X{a) = k 8(n - 2mn) + y-L 





-3n -In -n 0 n In 3n 



>12 


-3tt -274 f—n 0 i / n 2 jU /3n 

'"xfoU 1 ^- w 

' "" io W< \£2\<n 


» i 1 * T I I ! 1 1 i i k 

-6 -4 -2 0 2 4 6 


-► 12 


— 2tc ^ ^ 0 tk ^ 2n ^ 

ft ^ ^ 

<N OJ <N tN 

1 I 

JT(q) = 2tt]T <5(X2 -Q 0 - 2 nm) 

m= -°° 2n 

I I i t 


-+Q 


q - 2 k q 
£ £ 

T 7 


o q 2 k c; 

£ 


x(n) = n >r [5(fi + - 2 mn )+s(a-c 2 0 - 2 mk)] 


TT^ 


, T 

III 


tt 

tt 

tt 

tt 

* 

0 

rj\y k 

1 1 

1 1 

1 1 

1 


cf Cjf -2 n 

bi bi 

7 7 

1 f f 

K 

7 

o' 

0 q° q 2 n 

R 

CN 

o' 0 

9 9 

bi bi 
(N 
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From the Euler’s formula, we know that |exp(— ]fik)\ = 1. Therefore, an alter- 
native expression to verify the existence of the DTFT is given by 

OO 

E I*™ < oo. 

k——oo 

Condition for the existence of DTFT The DTFT X(ft) of a DT sequence x [A:] 
exists if 

OO 

E \x[k]\ < oo. (11.2830) 

k = — oo 

Equation ( 1 1 .2830) is a sufficient condition to verify the existence of the DTFT. 

Example 11.8 

Determine if the DTFTs exist for the following functions: 

(i) causal exponential function, x\[k] — p k u[k], 

(ii) cosine waveform, X 2 [k\ = cos(l7oA:). 

Solution 

(i) Equation (1 1.2830) yields 

OO OO OO 

E i*it*]i= E iAmi = ei/i = 

k — — oo k =— oo k = 0 

Therefore, the DTFT of the exponential sequence x\[k] = p k u[k] exists if 0 < 
\p\ < 1 . Under such a condition, x\ [T| is a decaying exponential sequence with 
the summation in Eq. (1 1.2830) having a finite value. 

(ii) Equation (1 1.2830) yields 

OO OO 

E l x 2 [fc]| = E I c°s(T2o^)l -> oo- 

k = — oo k=—o o 

Therefore, the DTFT does not exist for the cosine waveform. However, this 
appears to be in violation of Table 1 1 .2, which lists the following DTFT pair 
for the cosine sequence: 

OO 

cos(ftok) < > 7 r E + -Co — 2 nm) + S(ft — T?o — 2^/«)]. 

m =— oo 

Looking closely at the above DTFT pair, we note that the DTFT X(ft) of the 
cosine function consists of continuous impulse functions at discrete frequencies 
ft — ( ± i?o — 2nm), for — oo < m < oo. Since the magnitude of a continuous 
impulse function is infinite, \X(S7)\ is infinite at the location of the impulses. 
The infinite magnitude of the impulses in the DTFT X(ft) leads to the violation 
of the existence condition stated in Eq. (1 1.2830). 

Example 11.8 has introduced a confusing situation for the cosine sequence. 
We proved that the condition of the existence of the DTFT is violated by the 


0 < \p\ > 1 

1 - p 

oo \p\ > 1. 
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cosine waveform, yet its DTFT can be expressed mathematically. A similar 
behavior is exhibited by most periodic sequences. So how do we determine 
the DTFT for a periodic sequence? We cannot use the definition of the DTFT, 
Eq. (11.28b), since the procedure will lead to infinite DTFT values. In such 
cases, an alternative procedure based on the DTFS is used; this is explained in 
Section 1 1.4. 


11.4 DTFT of periodic functions 


Consider a periodic function x[k ] with fundamental period K {) . The DTFS 
representation for x[A:] is given by 

x[k]= Y D„e inSlok , (11.2831) 

n=(K 0 ) 

where Qq — 2tc / K {) and the DTFS coefficients are given by 

D n = — Y x[k]Q-i nn ° k . (11.2832) 

K ° k= {Ko) 

Calculating the DTFT ofboth sides ofEq. (11.2831), we obtain 

X(Q) = 3 I Y D„e inSlok 

[n=(K 0 ) 

Since the DTFT satisfies the linearity property, the above equation can be 
expressed as follows: 

X(f2)= Y D„»{e jnfioA }, (11.2833) 

n=(K a ) 

where the DTFT of the complex exponential sequence is given by 

OO 

»{e jnfi0<r } = 2tt Y S ( n ~ nQ o ~ 2 jrm). 


Using the above value for the DTFT of the complex exponential, Eq. (1 1.2833) 
takes the following form: 

OO 

X{f2)= Y D n 2lt E <5(C — nf2o — 2 it in). 

n={K 0 ) m =— oo 

By changing the order of summation in the above equation and substituting 
Co = 2n / Kq, we have 

x ^ / 2/171 

X{fi) = 2 jt Y] Y1 ( C 2jrm 

m=—oon=(Ko) ^ 

Since the DTFT is periodic with a period of 2tt, we determine the DTFT in 
the range fl = [0, 27t] and use the periodicity property to determine the DTFT 
values outside the specified range. Taking n = 0, 1, 2, . . . , Kq — 1 and m = 0, 


486 


Part III Discrete-time signals and systems 


the following terms of X(Q) lie within the range Q = [0, 2tc]: 

5 1 L 

V K o 


X{Q) = 2ttDq8{Q) + 2ttD\8 I Q- — ) + 27rD 2 <5| 12- ^ 


K n 


or 


, t „ 2 (JSTo- 1)tt^ 

+ • • • + 2tc D fc a -\8 ( 17 — I 


E ( 

D n 8 Q 

n=(K 0 ) \ K ° 


(11.34a) 


(11.34b) 


for 0 < 17 < 27 r. Since X(Q) is periodic, Eq. (1 1.34b) can also be expressed as 
follows: 


OO 

X(Q) = 2 : r E D » S 

n =— oo 



(11.35) 


which is the DTFT of the periodic sequence x[k ] for the entire 17-axis. The 
values of the DTFS coefficients lying outside the range 0 < n < ( K {] — 1) are 
evaluated from Eq. (1 1.9) to be 


D n — Tln+mA'o ^4r Ul £ Z. 


Definition 11.5 The DTFT X (17) of a periodic sequence x [/:] is given by 


OO 

X{Q) = 2jt E D » S 

fl — — OO 




(11.36a) 


where D n are the DTFS coefficients of x[k\. The DTFS coefficients are given 
by 

D n = E e m^ nSiok (n.36b) 

K ° k=(K 0 ) 

for 0 < n < Kq — 1 and the values outside the range are evaluated from the 
following periodicity relationship: 


D n = D n+mKo for meZ. (11.36c) 


Example 11.9 

Calculate the DTFT of the following periodic sequences: 


(i) x\[k] — k for 0 < k < 3, with the fundamental period Kq = 4; 


(ii) x 2 \ [k] = 


5 

0 


k = 0, 1 
k = 2, 3, 


with the fundamental period Kq = 4; 


(iii) x 3 [k] = 0.5* 

(iv) x 4 [/c] = 3 sin 


for 0 < k < 14, with the fundamental period Kq — 15; 
27 r 7 r \ 



with the fundamental period K 0 = 7. 
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Fig. 11.9. DTFT of the periodic 








pfi(A)| 



sequence xfiAr] = k. 

3k 




3k 



0 < k < 3, with fundamental 

i 

V 

42. K 

K 

42k 

j 

i 

42 k 

K 

42 k 

period K 0 = 4. (a) Magnitude 

. • . 


t 

A 




t 

A 

t 

spectrum; (b) phase spectrum. 

-In 

-1.5;r 

-n 

—0.5k 



0.5 k 

K 

1.5tt 


(a) 


In 


< X i(0> Ik 


4 


4 


. 1 

— 0.5tt 

1 

1.5tt 




-2k -1.5 K -K 


0 0.5^ k 


2k 


(b) 


3 n 
”4 


Jt_K 

~4 


Solution 

(i) Using Eq. (1 1.36a), the DTFT of xi[£] is given by 

Xi(fi) = 2 ir D n 8 ln 1=2 it ^ D „8 j. 

n——oo \ / n =— oo 

Substituting l?o = 2n/Ko = jt/2 in Eq. ( 1 1 ,36b), the DTFS coefficients/),, for 
are given by 

1 3 I 

D„ = ~J2 ks ~ Vmk/1 = - [e~j' !7r/2 + 2&~' vm + 3e- j3 ' ,7r/2 ]. 

^ fc =0 ^ 

For 0 < n < 3, the values of the DTFS coefficients are as follows: 

n — 0 Do =i[l + 2- 1 + 3-1]=^; 

4 2 

n = 1 Dj = 1 [e~ j7T/2 + 2 ■ e“ j7r + 3 • e~ j3,r/2 ] 

= ^[-j+2(-l) + 3(7)] = -^[l-j]; 

n = 2 Dt = - [e“ jjr + 2 • e" j2,r + 3 ■ e~ j37r ] 

4 

= i[-l+2(l) + 3(-l)] = -i; 

n = 3 D 3 = 1 [ e - j37r/2 + 2 • e~ j3lr + 3 • e" j97r/2 ] 

= i[y+2(-l) + 3(-j)] = -^[l + y]. 

The values of the DTFS coefficients that lie outside the range 0 < n < 3 can 
be obtained by using the periodicity property D n+ 4 = l )„ . 

Since X\(Q) is a complex-valued function, its magnitude and phase spectra 
are plotted separately in Figs. 1 1.9(a) and (b). The area enclosed by the impulse 
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Fig. 11.10. DTFT of the periodic 
sequence X 2 [k], with 
fundamental period K 0 = 4. 

(a) Magnitude spectrum; (b) 
phase spectrum. 


5k 

A 


-2k 


J2 

-\.5n - K 


(a) 


. . . —1.5 K 

-2k I —K 

K 

4 

(b) 



5k 

▲ 


\X 2 (C2)\ 

5 

c/2 


-0.5;r 0 0.5rr 


K 

4 

_X 

-0.5 k 


<X 2 (Q) 


0 


0.5jt 

X 

K 

4 


K 


K 


1 

1 .5tt 


5k 


+-Q 

2k 


K 

4 

X 

1.5rr 


-•-►12 

2k 


functions in the magnitude spectrum is given by 2 jt D„ and is indicated at the 
top of each impulse in Fig. 1 1.9(a). 

(ii) Using Eq. (1 1.36a), the DTFT of x 2 [£] is given by 

( 2 ujt \ / mr \ 

x 2 (n) = 2it D„sln \=2tz 22 D n s(n J. 

n=—G o c ^ / «=— oo 


Substituting Qq = 2jt / Kq = jt /2 inEq. (11.36b), the DTFS coefficients D„ are 
as follows: 


k = 0 


■]nnk/2 


i 


= -[5 + 5e~ j ™ /2 ] = -e -'“'•'’cos 


-jrrn/4 . 




For 0 < n < 3, the values of the DTFS coefficients are as follows: 
n = 0 (D = 0 ) 


Dq — ^ with | D 0 1 = <D 0 = 0; 


n = 1 (H = 0.5tt) Di = 
n — 2 (D — Jt) 


a -jjr/4 


with | Do | = 


JT 


2y/2 

D 2 = 0 with | D 0 1 = 0, <D 0 = 0; 


— 7 =, <Do = — — ; 

2 V 2 4 


n — 3(D = 1 . 5 : 1 ) D 3 = — e i7,lz D with |D 0 | = 


2V2 2V2 

37T jt 

<D0 = Jt - — = -. 

The magnitude and phase spectra are plotted separately in Figs. 11.10(a) and 
(b), where the values of the DTFS coefficients lying outside 0 < n < 3 are 
obtained using the periodicity property D „ + 4 = D„ . 

(iii) Using Eq. (1 1.36a), the DTFT of x 2 [ k ] is given by 

^ / 2njr \ 

X 2 (f2) = 2ji J2 D„5( D- — J. 

n — — \ / 
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Table 11.4. Values of |D„| and <D n forO < n < 14 in Example 11.9(iii) 

The radian frequency Q corresponding to each value of n is given in the second row 

n 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 

Q 0 2tt/15 4jt/15 6jt/15 8tt/15 IOtt/15 12jt/15 14tt/15 16jt/15 18jt/15 20tt/15 22tt/15 24tt/15 26tt/15 28tt/15 

\D n \ 0.133 0.115 0.088 0.069 0.057 0.050 0.047 0.045 0.045 0.047 0.050 0.057 0.069 0.088 0.115 

<D„ 0 — 0.1 lw — 0.16 tt — 0. 16jt -0.14tt -0.1 Ijt 0.07 n 0.02 ? r 0.02tt 0.07jt 0.1 hr 0.14 tt 0.16jt 0.16jt 0.1 Itt 


The DTFS coefficients of x ? | k | are computed in Example 11.3. Substituting 
l7o = 2 tv/Kq = 2n/15 in Eqs. (11.1 1) — (1 1.13), we obtain 


/ \ 

1 

( 2nit \ ( 2nn \ 

(l -0.5co s (— j+J0.5sin(— 


where the magnitude component is given by 

/ 

1 1 

IAil = i5 ~r— 

/ 1.25 — cos I 


/ 2 nn \ 

1 ^ 5 "// 


and the phase component is given by 


<D n = —tan 1 


( 2«7T 
— 

15 


1 — 0.5 cos 


2nn 

~15~ 


The magnitude and phase components of the DTFS coefficients D n for 0 < 
n < 14 are given in Table 11.4. 

The values of the DTFS coefficients, lying outside 0 < n < 14 are obtained 
using the periodicity property D, t+ u = D n . The magnitude and phase of 
are plotted in Fig. 11.11. 

(iv) In Example 1 1.5, the DTFS coefficients D n of x 4 1 k | are computed and 
are given by Eq. (11.19), which is reproduced here: 


D 


n 


— jl.5ej ?r/4; forn = 1 

jl.Se”^ 4 ’ forn = — 1 for — 1 < n < 5 
0 elsewhere. 


The values of the DTFS coefficients lying outside — 1 < n < 5 are obtained 
using the periodicity property D n+ 7 = D n . Using Eq. (11.36a), the DTFT of 
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Fig. ll.ll. DTFT of the periodic 
sequence 

> <i[k] = 0.5*tf[Ar], 0 < k < 14, 
with fundamental period 
Ko = 15. (a) Magnitude 
spectrum; (b) phase spectrum. 


Fig. 11.12. DTFT of the periodic 
sequence x 4 [k], with 
fundamental period K 0 = 7. 

(a) Magnitude spectrum; 

(b) phase spectrum. 


0.266k 


•til 


\x 2 (n)\ 

0.2667T 0.2667T 


->T2 


-2k -1.5 k -k n -0.5k 0 0.5k n 1.5k In 


(a) 


<X 3 (£2) 


0.163k 


0.163k 


-0.5k 


-ii 1 1 i 1 1 V 


. T T T 11 T . ° 5 * . T T T H T 


-0.5k 0 


U1U‘V 


-0.163k 


(b) 


-0.163k 


\X 4 (0)\ 


3k 

1 


3k 3k 

▲ A 


->T2 


1.5k 2k 


3k 

▲ 


->T2 


-2k -1.5k -k k -0.5k 0 0.5k k 1.5k 2k 


(a) 


<X 4 (i2) 


-2n ^ -1.5k 

-0.25k 


0.25k 


0.25k 


->T2 


-K K -0.5k 


0 • 0.5k k 1.5k 2k 

-0.25k 


(b) 


x 4 [k] is given by 

^ / 2mt\ 

X 4 (ft) = 2jt J2 D„sln-— j 


2htc \ 


2 nit \ 


E / z.nji \ v — > / \ 

£>!<$( T2 —j + 2 tc Z)_ 1 <5 — j 

n=7m+l n=lm — \ 

= S (ft — — 2m7t\ 

m=—oo \ / 

+ j37r e~j (lr ^ 4) & (ft + ^ 2mjt 


The magnitude and phase of X 4 (ft) are plotted in Fig. 11.12. 
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11.5 Properties of the DTFT and the DTFS 


In this section, we present the properties of the DTFT. These properties are 
similar to the properties for the CTFT discussed in Chapter 5. In most cases, 
we do not explicitly state the DTFS properties, but a list of the DTFS properties 
is included in Table 1 1.5. 


11.5.1 Periodicity 

DTFT The DTFT X(fl) of an arbitrary DT sequence x[k] is periodic with a 
period Qq — 2i r . Mathematically, 

X(H)= X(n + 2 it). (11.37) 

DTFS The DTFS coefficients D n of a periodic sequence x[n] with period Kq 
are periodic with respect to the coefficient number n and has a period Kq. In 
other words, 


D n = D n+mKo , (11.38) 

for 0 < n < Kq — 1 and — oo < m < oo. Recall that the coefficient num- 
ber n — Kq corresponds to the frequency Q„ — 2nn/KQ — 2n. Therefore, 
the frequency-periodicity property of the DTFS and DTFT are in fact the 
same. 


11.5.2 Hermitian symmetry 

The DTFT X(f2) of a real- valued sequence x[k] satisfies 

X{-f2) = X*(.C), (11.39a) 

where X*(fl) denotes the complex conjugate of X(S7). By expressing the DTFT 
X(Q) in terms of its real and imaginary components, 

X(H) = Re{X(f2)} + j Im{Z(f2)}, 

Eq. (1 1.39a) can be expressed as follows: 

Re{X(-f2)} +jIm{X(-12)} = Re{X(D)} -jIm{X(D)}. 

Separating the real and imaginary components yields 

Re{X(-12)} = Re{X(12)} and Im{X(-J2)} = -Im{X(J?)}, (11.39b) 

which implies that the real component Re{X(l?)} of the DTFT X(Q) of a real- 
valued sequence x[k] is an even function of frequency 1? and that its imaginary 
component Im{X(f2)} is an odd function of fl. In terms of the magnitude and 
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phase spectra of the DTFT X(Q), the Hermitian symmetry property can be 
expressed as follows: 

|X(-J2)| = |X(J?)| and <X(-(2) = - <X{Q), (11.39c) 

implying that the magnitude spectrum is even and that the phase spectrum is 
odd. 

As extensions of the Hermitian symmetry properties, we consider the special 
cases when: (a) x [£] is real- valued and even and (b) x [£] is imaginary-valued 
and odd. 

Case 1 If x[k] is both real- valued and even, then its DTFT X(.Q) is also real- 
valued and even, with the imaginary component Im{A(l?)} = 0. In other words, 

Re{A(-f?)} = Re{A(I2)} and Im{X(-I2)} = 0. (11.39d) 

Case 2 If x[k] is both imaginary-valued and odd, then its DTFT X(Q) is also 
imaginary-valued and odd, with the real component Re{X(J7)} = 0. In other 
words, 


Re{X(— 1?)} = 0 and Im{X(-I2)} = -Im{X(J?)}. (11.39e) 


11.5.3 Linearity 

Like the CTFT, both the DTFT and DTFS satisfy the linearity property. 

DTFT If xi [L' | and x 2 [k] are two DT sequences with the following DTFT pairs: 
xi [k] < l) " 1 > X\(il) and x 2 [k] < ■ ” > X 2 (l? ), 
then the linearity property states that 

a\X\[k] + a 2 x 2 [k] < DTFT > ci\X\(ft) + a 2 X 2 (Q), (11.40a) 

for any arbitrary constants a i and a 2 , which may be complex-valued. 

DTFS If xi [k] and x 2 [k] are two periodic DT sequences with the same funda- 
mental period Kq and the following DTFS pairs: 

r; i DTPS n j, , r/ , DTFS x 
x\[k\ < > D*' and x 2 [k} < >• D n 2 , 

then the DTFS coefficients of the periodic DT sequence x-s[k] = a\X\[k] + 
U 2 X 2 [k\. which also has a period of Kq, are given by 

aixi[k] + a 2 x 2 [k ] < DTFS > a x D^ + a 2 D^, (11.40b) 

' v- V- ' 

Xi[k] 0 «3 

for any arbitrary constants nr and a 2 , which may be complex-valued. 
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11.5.4 Time scaling 

The time-scaling property of the CTFT, defined in Section 5.4.2, states that if a 
CT function x(t ) is time-compressed by a factor of a ( a ^ 0), its CTFT X(o>) is 
expanded in the frequency domain by a factor of a, and vice versa. For the DTFT, 
the time-scaling property has a limited scope, as illustrated in the following. 

Decimation Since decimation is an irreversible nature of the decimation oper- 
ation, the DTFT of x[k] and the decimated sequence y[k] = x[mk] are not 
related to each other. 


Interpolation In the DT domain, interpolation is defined in Chapter 1 as 
follows: 


x (m) [£] 



if A: is a multiple of integer m 


0 otherwise. 


(11.41a) 


The interpolated sequence x (m) [A:] inserts (m — 1) zeros in between adjacent 
samples of the DT sequence x[k]. The time-scaling property for the interpolated 
sequence x (m \k\ is given as follows. 

If 


x[k] < DTFT > X(C), 


then the DTFT X <m) (U) of x (m) [k] is given by 


X {m \n) = I(rafl), (11.41b) 


for 2 < m < oo. Equation (11.41b) shows that interpolation in time results in 
compression in the frequency domain. To demonstrate the application of the 
interpolation property, consider the DTFT of a rectangular sequence: 


x[k\ = rect( - 


DTFT 
C >- 


sin (3.512) 
sin (0.512) 


Using the interpolation property, the DTFT of the interpolated function x (2) [£] 
for m = 2 is given by 


x (2) [At] < DTFT > X(212) = 


sin(3l2) 

sin(l2) 


The functions x[k] and a' , 2, [A] and their DTFTs are shown graphically in Fig. 

11.13. 


11.5.5 Time shifting 

The time-shifting operation delays or advances the reference sequence in time. 
Given a signal x[k], the time-shifted signal is given by x[k- Ci l, where k {) is 
an integer. If the value of the shift ko is positive, the reference sequence x [A:] 
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(a) 


JC( 2 )[*] 

1 1 1 


-6 -4 -2 0 2 4 6 


X( 2 XQ) 


->A 


-27T 



► 12 


K 2k 


(b) 


Fig. 11.13. Time-scaling 
property, (a) DTFT pair for a 
rectangular sequence x[k] with a 
length of seven samples, (b) 
DTFT pair for*® [A] obtained by 
interpolating x[k] by a factor of 
m = 2 . 


is delayed and shifted towards the right-hand side of the A-axis. On the other 
hand, if the value of the shift Ao is negative, sequence x [A] advances and is 
shifted towards the left-hand side of the A-axis. The DTFT of the time-shifted 
sequence x[k- Ao] is related to the DTFT of the reference sequence x[k ] using 
the following time- shifting property. 

If 

DTFT 

x[A] < > X(s2) 


then 


x[k - A 0 ] J e-^ n X(n), (11.42) 

for integer values of Ao. 

Example 11.10 

Using the time-shifting property, calculate the DTFT of the following sequence: 


x[k] = 


0.75 

0.5*- 12 

0 


(3 < A < 9) 
(12 < A < oo) 
elsewhere. 


Solution 

The DT sequence x[A], plotted in Fig. 11.14, can be expressed as a linear 
combination of: (i) a time-shifted gate or rectangular sequence, denoted by 
xi[A] in Example 1 1.6, (ii), as follows: 

A 

2N + 1 



X 2 [A] = rect 


1 ] A | < N 

0 elsewhere. 
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Fig. 11.14. DT sequence x[£] 
used in Example 11.10. 


-4 -2 


x[k] 

0.75 


0 2 4 6 8 10 


1 

T 0.5 

0.25 

T ,0.125 

lit... 

12 14 16 18 


k 


with N = 3; and (ii) a time-shifted decaying exponential sequence, denoted by 
x 3 [ k ] in Example 11.6, (iii), as follows: 

X 3 [£] = p k u[k\, 

with decay factor p = 0.5. In terms of X 2 [k] and x 3 [&], the expression for x[k] 
is given by 

x[k] = 0 . 75 x 2 [k - 6 ] + x 3 [k - 12 ]. 

Using the linearity and time-shifting properties, the DTFT X(f2) of x[k\ is given 
by 

X(C2) = 0.75e- j 6 fl Z 2 (f7) + e“ jlM X 3 (f7). 


From the results in Example 1 1.6, the DTFTs for the sequences x 2 [k] and X 3 [A:] 
are given by 


X 2 (H) = 


sin(3.5i?) 

sin(0.5i?) 


and 


X 3 (f2) = 


1 

1 -0.5e~j fi ' 


Substituting the values of the DTFTs results in the following: 

X(Q) = 0.75e~ j6fl Sm(3,5J?) + e~ jlM -. 

sin(0.5l?) 1 - 0.5e~J fi 


11.5.6 Frequency shifting 

In the time-shifting property, we observed the change in the DTFT when the DT 
sequence x [k \ is shifted in the time domain. The frequency-shifting property 
addresses the converse problem of how shifting the DTFT X(()) in the frequency 
domain affects the sequence x [T] in the time domain. 

If 

x[k] < DTFT > X(f2) 

then 

x[k]e in ° k <' )nT > X(f2-f2 0 ), (11.43) 

for 0 < kit) < 2 ji. 

Example 11.11 

Using the frequency-shifting property, calculate the DTFT of x[k ] = 
cos(l?o^) cos(l?iA:) with (l?o + Q 1 ) < it. 


496 


Part III Discrete-time signals and systems 


Solution 

Using Table 1 1.2, the DTFT of cos(12o&) is given by 

OO 

cos(12o&) < * 7 r ^2 [5(12 + i?o — 2mjt) + 5(12 — 12o — 2mir)]. 

m=— oo 

Using the frequency-shifting property, 

CO 

cos (n 0 k)e in ' k < DTFT > 7T ^2 [5(12 + Mo -Ml- 2mn) 

171— —OO 

+ 5(12 — 12o — J?i — 2mit)] 

and 

OO 

cos(12 0 A;)e“ jni * < DTFT > 7T J2 [5(12+ 12 0 + 12i - 2m tt) 

m=—o o 

+ 5(12 — 12o + 12i — 2mjr)]. 

Adding the two DTFT pairs and noting that [exp(j<?+) + exp(— jnifc)] = 
2cos(12i^), we obtain 

OO 

DTFT 7T 

cos(12o&) cos(f2\k) < > — 2_^ [5(12+ 12o — 12i — 2 mix) 

m=— oo 

+ 5(12 — 12o — 12! — 2m7r) 

+ 5(12 + 12o + 12 j — 2.17111 ) 

+ 5(12 — l?o + T2i — 2/7? 7T )] . 

The above DTFT can also be obtained by expressing 

2 cos(12oA:) cos(12i^) = cos[(12o + f2\)k] + cos[(12o — fi\)k] 

and calculating the DTFT of the right-hand side of the above expression. 

11.5.7 Time differencing 

The time differencing in the DT domain is the counterpart of differentiation in 
the CT domain. The time-differencing property is stated as follows. 

If 

DTFT 

x[k\ < > X(S2) 

then 

x[k] - x[k - 1] < DTFT > [1 - e- jfl ]X(12). (11.44) 


The proof of Eq. (11.44) follows directly from the application of the time- 
shifting property. 
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Example 11.12 

Based on the DTFT of the unit step u [A:] and the time-shifting property, calculate 
the DTFT of x[k] = S[k], 


Solution 

Using Table 11.2, the DTFT of the unit step function is given by 


rl , DTFT 
u[k] < > 7 r 


8(f2 — 2nnt) + — 


1 


e -j fl 


Applying the time-differencing property yields 


... r , , . DTFT .. | <} . 

u[k] — u[k — 1J < > (1 — e J ) 


71 


< 5(12 — 2mn) ■ 


1 - e~j fi 


which reduces to 


[k]-u[k- 1] 1+ tt J2 ^-2m7r)(l-e- jfi )|„ =2m3r . 


Since [1 — exp(— j2;«7r)] = 0, the above DTFT pair reduces to 

DTFT i 

< 5 [£] < >■ 1 . 


11.5.8 Differentiation in frequency 

if 

then 


x [k] < DTFT - > X(f2) 


DTFT 

— )kx [k\ < > 


dX 

dn' 


(11.45) 


Example 11.13 

Based on the DTFT of the exponential decaying function and the frequency 
differentiation property, calculate the DTFT of x[A;] = (k + 1 )p k u[k\. 


Solution 

In Table 11.2, the DTFT of the exponential decaying function is given as 


k r , DTFT 
p u[k] < ► 


1 


1 — pe~i n 

Using the frequency-differentiation property, we obtain 

. ... k rI1 DTFT d T 1 
(-J k)p u[k] < ► — 


dl? [ 1 — pe 


; jf2 


-j pe iS2 


(1 — p&~ J fi ) 2 


or 


DTFT 


kp u[k] < > j — 


dfi [ 1 — pe~ 


pe 


— jl? 


(1 — pe~i n ) 2 
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Adding the DTFT pairs for p k u[k] and k/f u [k ] yields 


(k + \)p k u[k] 4 


DTFT 


1 


+ 


pe 


—)f2 


1 — pe ~ (1 — per i n ) 2 (1 — pe~> n ) 2 


11.5.9 Time summation 

The time summation in the DT domain is the counterpart of integration in the 
CT domain. The time-summation property is defined as follows. 

If 

DTFT 

x[k\ < > X(S2) 

then 

k y oo 

x[n] < DTFT > — X(12) + ttX(O) (11.46) 

n =— oo ^ ^ ^ m=—o o 


Example 11.14 

Based on the DTFT of the unit impulse sequence and the time-summation 
property, calculate the DTFT of the unit step sequence. 


Solution 

Using Table 1 1.2, the DTFT of the unit impulse sequence is given by 

sr ,, DTFT 

5[fc] < > 1. 

Using the time-summation property, we obtain 

k ^ oo 

Y 5 [n] < DTFT > — ■ 1 + jt ■ 1 &{Q — 2 nm), 

L — / J — Q—JM / 


which yields 


rl , DTFT 1 
u[k] < ► r- + 7T 

1 — e _ J^ 


5(12—27 rm). 


11.5.10 Time convolution 

In Section 10.5, we showed that the output response of an LTID system is 
obtained by convolving the input sequence with the impulse response of the 
system. Sometimes the resulting convolution sum is difficult to solve analyti- 
cally in the time domain. The convolution property provides us with an alter- 
native approach, based on the DTFT, of calculating the output response. Below 
we state the convolution property and explain its application in calculating the 
output response of an LTID system using an example. 

If x \\k\ and X 2 [k \ are two DT sequences with the following DTFT pairs: 

x\[k\ < > and X 2 [k\ < > ^(12), 
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then the time-convolution property states that 


x x [k] * x 2 [k] < DTFT > X l (n)X 2 (f2). 


(11.47) 


In other words, the convolution between two DT sequences in the time domain is 
equivalent to multiplication of the DTFTs of the two functions in the frequency 
domain. Note that the CTFT also has a similar property, as stated in Section 


Equation (11 .47) provides us with an alternative technique for calculating the 
convolution sum using the DTFT. Expressed in terms of the following DTFT 
pairs: 

x[k] < DTFT > X(Q), h[k] < DTFT > U(Q), and y[k] < DTFT - > Y{fi ) ■ 

the output sequence y[k\ can be expressed in terms of the impulse response 
h[k] and the input sequence x[k\ as follows: 


In other words, the DTFT of the output sequence is obtained by multiplying 
the DTFTs of the input sequence and the impulse response. The procedure for 
evaluating the output y|T] of an LTID system in the frequency domain therefore 
consists of the following four steps. 

( 1 ) Calculate the DTFT X(Q) of the input signal x[k\. 

(2) Calculate the DTFT H(S7) of the impulse response h [k] of the LTID system. 
The DTFT H(Q) is referred to as the transfer function of the LTID system 
and provides a meaningful insight into the behavior of the system. 

(3) Based on the convolution property, the DTFT of the output y[k\ is given 
by Y{Q) = H(i l)X(Q). 

(4) The output y [k | in the time domain is obtained by calculating the inverse 
DTFT of Y (Q) obtained in step (3). 

Since the DTFTs are periodic with period f2 = 2 tx , steps (l)-(4) can be applied 
only to the frequency range [— n < fi < jt]. 

Example 11.15 

The exponential decaying sequence x[k] = a k u[k], 0 < a < 1 , is applied at the 
input of an LTID system with the impulse response h[k\ — b k u[k], 0 < b < 1. 
Using the DTFT approach, calculate the output of the system. 

Solution 

Based on Table 11.2, the DTFT s for the input sequence and the impulse response 
are given by 


5.4.8. 


y[L] = x[k] * h[k] < DTFT > Y(H) = X{Q)H{Q). 


(11.48) 


x[k\ <■ 


DTFT 



DTFT 1 


1 — 
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The DTFT Y (12) of the output signal is therefore calculated as follows: 


y[k\ = x[k] * h[k] <- DTFT > Y(Q) = 


1 

(1 — ae~ J fi )(l — bor 


The inverse of the DTFT F(l?) takes two different forms depending on the 
values of a and b: 


1 


Y{Q) = 


(1 — ae~ J fi ) 2 

1 


(1 — ae~J fi )(l — £>e ~ > n ) 


a = b 
a ^ b. 


We consider the two cases separately. 


Case 1 (a —b) The inverse DTFT follows directly from Table 1 1 .2 as follows: 
y[k] = (k+ 1 )a k u[k+ 1]. 


Case 2 (a y^b) Using partial fraction expansion, the DTFT Y (12) is expressed 
as follows: 


F (12) = 


B 


1 — ae .~ 1 — be~i n ’ 
where the partial fraction coefficients are given by 


A = 


1 

1 — be~i n 


-j^=l 


and 


B = 


1 

1 — ae~ 


be~> n = 1 


a — b 


a — b 


(11.49) 


Substituting the values of A and B in Eq. ( 1 1 .49) and calculating the inverse 
DTFT yields 

y[k] = — [a k+l - b k+l ]u[k]. 
a — b 


Combining case 1 with case 2, we obtain 


y[k] = 


\k+ 1 )a k u[k] 

— [ — [a k+x -b k+l ]u[k] 
a — b 


a — b 
a ^ b. 


(11.50) 


11.5.11 Periodic convolution 

The time-convolution property, defined by Eq. (11.35), is used to calculate 
the output of convolving aperiodic sequences. In Section 10.6, we defined the 
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V*] 


3 

2 2 



-4 - 3 - 2-1 0 1 2 


Fig. 11.15. Periodic sequences 
x p [k] and h p [k] used in Example 
11.16. 


.JlI 


3 4 5 6 7 


► k 


»[*] 


5 5 


• — • 


► k 


-4 -3 -2 -1 0 1 2 3 4 5 6 7 


periodic, or circular, convolution to convolve periodic sequences. We now show 
how the periodic convolution can be calculated using the DTFS. 

If X\ [A'] and xi[k] are two DT periodic sequences with the same fundamental 
period Kq and the following DTFS pairs: 


x\[k] 


DTFS 


D x n l and x 2 [k\ 


DTFS 


Dl 2 , 


then the periodic convolution property states that 

xi [k]®x 2 [k]<^> K 0 D x n 'D x n 2 . (11.51) 


We illustrate the application of the periodic convolution property by revisiting 
Example 10.10. 


Example 11.16 

In Example 10.10, we calculated the periodic convolution v p [A:] of the two 
periodic sequences x p [£] and h p [k], defined over one period),^ = 4) as jc p [/c] = 
k, 0 < k < 3, and h p [k) = 5, 0 < k < 1, in the time domain. Repeat Example 
10.10 using the periodic convolution property. 


Solution 

The periodic sequences x p [k\ and h p | k ] are shown in Fig. 11.15. In part (i) of 
Example 11.9, we calculated the DTFS coefficients of x p [k ] as follows: 

»o P = 2 ’ D X x=-\l'-il °2=-\> and = - X -[\+]}. 
Similarly, in part (ii) of Example 1 1 .9 we calculated the DTFS coefficients of 

M*]: 

D h 0 >= 5 -, D h ^= 5 -[ 1-j], D^ = 0, and D^^l+j], 

Using the periodic convolution property, the DTFS coefficients of y p [T| are 
D* = KqDq p d'q = 15; 

D[ p = KqD X \ D hp =j5; 

«2 P = K Q D Xp D 2 P = 0; 

D\ p = KqDI p d'I v = — j5. 
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Calculating the inverse DTFS, the DT sequence v p | k | is given by 
VpM = J2 

n= 0 

= |^15 + j5 ■ e~^ k + 0 ■ e~ ink — j5 • e — -■ J . 

Calculating the values of y p [£] within one period (0 < ko < 3) yields 

k = 0 y p [0] = 15 +j5 — j5 = 15; 

k = 1 y p [l] = 15 +j5e” j ? - j5e~ j ¥ = 15 - 5 - 5 = 5; 

k = 2 y p [2] = 15 + j5e” jjr - j5e- j3?r = 15 - j5 + j5 = 15; 

k = 3 y p [3] = 15+j5e” j T -j5e“ j T = 15 + 5 + 5 = 25. 

The above result is identical to the result obtained in Example 10.10. 

Example 11.16 shows how periodic convolution can be calculated using 
the DTFS periodic-convolution property. A more computationally efficient 
approach of calculating the periodic convolution is based on the dis- 
crete Fourier transform (DFT). The theory of DFT will be presented in 
Chapter 12. 


11.5.12 Frequency convolution 

The time-convolution property (see Section 1 1.5.10) states that the convolution 
between two DT sequences in the time domain is equivalent to the multiplication 
of the DTFTs of the two sequences in the frequency domain. The converse of 
the time-convolution property is also true, and is referred to as the frequency- 
convolution property. 

If x \\k\ and X 2 [k \ are two DT sequences with the following DTFT pairs: 

X! [k] < DTFT > Xi(C) and x 2 [k] <° TFT > X 2 (C), 
then the frequency-convolution property states that 

DTFT 1 f 

xi [k]x 2 [k]< > — / Xi(d)X,(n-9) d<9. (11.52) 

27 r J 

<2j r) 

The limits of integration in Eq. (1 1.52) are given by (12 = 2jt), which implies 
that any range of 2tc may be chosen during the integration. 

The frequency-convolution property is widely used in digital communica- 
tions systems, where it is commonly referred to as the modulation property. 
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11.5.13 Parseval's theorem 

If x[k] is an energy signal and x [£] < . DTFT > the energy of the DT signal 

x[k ] is given by 

\x[k]\ 2 = E J \xm 2 dn. (11 . 53) 

(2tt> 

Parseval’s theorem states that the DTFT is a lossless transform as there is no 
loss of energy if a signal is transformed to the frequency domain. 



Example 11.17 

Using Parseval’s theorem, evaluate the following integral: 


/ 


(2 Jt) 


' 2N + 1 
sin I 1/ 


sin -Q 

,2 


dJ7. 


Solution 

Since 


rect 


2N + 1 


sin 


DTFT 
•< > 


2N+1 


Q 


sin | - fi 

,2 


Eq. (1 1.53) computes the area enclosed by the squared DT sine function within 
one period Q — (2 tt) as follows: 


1 

2tt 


/ 


sin 


2 N + 1 


n 


_. 2 


(2jt> l 


sin -1? 
.2 


df2 


E 


rect 


k 

2N+ 1 


2 


where 


rect 


k 


_2N + 1_ 



\k\ < N 
elsewhere. 


Simplifying the summation on the right-hand side of this equation yields 


/ 


(2 n) L 


sin 


2N+ 1 


n 


sin I -Q 


dl? = 2tt(2N + 1). 


We have presented several properties in Sections 11.5.1-11.5.12. Table 11.5 
lists the properties of the DTFS and Table 1 1.6 lists the properties of the DTFT. 
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Table 11.5. Properties of the DTFS: sequences x [A], X\ [A], and A' 2 [Ar] are periodic with a period of K 0 


Properties Time domain 


Frequency domain Comments 


Periodicity 

Linearity 

Scaling 

Time shifting 
Frequency shifting 
Time differencing 
Time summation 

Periodic convolution 

Frequency 

convolution 

Parseval’s relationship 


x[k] = D„e in{lok 

n={Ko) 

Xi l k ] 
xi [j k ] 
x[k\ 

a\X\\k] + a 2 Xj\k} 
x^ m) [k] 

with period mK 0 
x[k — L 0 ] 

exp 

x[k\ — x[k — 1] 

k 

S = 22 x[m] 


22 Xi[n]x2[n — k] 

n=(K o) 

XI [k]x 2 [k} 


1 

K~ 0 


J 2 l*MI 2 

k=(K 0 ) 


1 

Dn = — > Jf[^]e 

K ° k=<Ko) 

Dn l 
Dn 2 

D n — D n 4-^(1 
ai D;;> +a 2 D? 

1 

— Dn 
m 

f.2nk 0 i n 
ex P I D „ 


k 


K 0 


D„ 


2 7t 

1 - exp ( j —n 


D„ 


. 2n 
1 - exp h— n 


K 0 


Dn 


k 0 d?d? 


J 2 D 'n D 

m=(K 0 ) 

= E 

n=(K 0 ) 


1*2 

m—n 


l7o = 2 7T / A'o 

f?o = 2tt / Kq 
17 o = 2tt j Kq 

ci \ , ci 2 £ C 
m = 1,2,3, ... 

ko £ R 
n 0 e R 


summation S is 
finite only if 
D 0 = 0 

convolution over a 
period K 0 
multiplication in 
time domain 

power of a periodic 
sequence 


Symmetry properties 




DTFS: D = D* 

Comments 



real and imaginary 

real component is 



components: 

even; imaginary 

Flermitian property 

x[k] is a real- valued sequence 

J Re{D_„) = Re(D„) 
jlm{D_„) = — Im{D„l 

component is odd 

magnitude and phase spectra: 

magnitude spectrum 





[ |£-„l = \D„\ 

is even: phase 



1 <D-„ = - <D„ 

spectrum is odd 

Real-valued and even 
function 

x [k] is an even and real-valued 
sequence 

fRe{D_„! = Re{D„} 
|Im{D_„} = 0 

DTFS is real-valued 
and even 

Real- valued and odd 
function 

x [k] is an odd and real-valued 
sequence 

1 Re{D_„ j = 0 
(lm{D_„! = — Im{D„ j 

DTFS is imaginary 
and odd 
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Table 11.6. Properties of the discrete-time Fourier transform (DTFT) 


Transformation 

properties 


Periodicity 
Linearity 
Scaling 
Time shifting 
Frequency shifting 
Time differencing 

Time summation 


Time convolution 
Periodic convolution 

Frequency 

convolution 

Parseval's 

relationship 


Hermitian property 


Real- valued and 
even function 

Real- valued and odd 
function 


Time domain 


Frequency domain 


Comments 


x[k] = — [ X(n)e ikS2 d Q 
2n J 

(2jt> 

xd k] 
x 2 [k] 
x\k\ 

aixdk] + a 2 X2 W 
x^ik] 
x[k - k 0 \ 
exp(jLf2 0 )x[L] 
x[k} — x[k — 1] 

k 

S = ^ x[m\ 

m=—oo 


xdk] * x 2 \k] 
*i[fc] <8> x 2 [k ] 

xi [k\x 2 [k] 



X(Q) = 


oo 

J2 x[k]e~ im 

k =— oo 


Xi(«) 

x 2 (n) 

X(Q) = X(Q + 2rt) 
ciiXi(O) + a 2 X 2 (f2) 


X (m fl) 


exp(— )k 0 Q)X(Q) 


X(Q - n Q ) 

[1 — exp( ]Q)]X{S7) 

1 


1 — exp(jD) 


X(H) + 


OO 

nX{ 0) E 8(0 — 2n m) 

m =— oo 


xdn) x 2 (n) 

xdo) x 2 (n) 

— I X l (0)X 2 (f2 — 6)d0 
2n J 
< 2 *> 

Ey |X(f2)| 2 df2 

(2tt) 


U \ , a 2 G C 
m = 1,2,3,... 
t'o C H 
L?o G R 


provided summation 
S is finite 


over period K 0 

multiplication in time 
domain 

energy in a signal 


Symmetry properties 


DTFT: X(-Q) = X*(Q) 


x\k\ is a real- valued function 


x\k\ is even and real- valued 
x\k\ is odd and real- valued 


real and imaginary component: 

[ RejX(-D)} = Re{X(f2)} 
|lm{Z(-f2)} = — Im{X(l?)( 


real component is 
even: imaginary 
component is odd 


magnitude and phase spectra: 
||X(-f2)| = |X(fi)| 
j <X(-D) = - <X(0) 

|Re{X(-D)) = Re{X(f2)} 
jlm{X(D)} = 0 

I Re{X(— 17)} =0 
(Im{X(-D)} = -Im{X(D)l 


magnitude spectrum 
is even; phase 
spectrum is odd 

DTFT is real-valued 
and even 

DTFT is imaginary 
and odd 
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11.6 Frequency response of LTID systems 


In Chapter 10, we presented two different representations to specify the input- 
output relationship of an LTID system. Section 10.1 used a linear, constant- 
coefficient difference equation, while Section 10.3 used the impulse response 
h [A:] to model an LTID system. A third representation for an LTID system is 
obtained by calculating the DTFT of the impulse response, 

h[k] < DTFT > H(ft). 

The DTFT // (ft) is referred to as the Fourier transfer function of the LTID 
system. In conjunction with the linear convolution property, the transfer function 
FI (ft) can be used to determine the output response y[k] of the LTID system 
due to the input sequence x[k], In the time domain, the output response y[k] is 
given by 

y[k] = x[k] * h[k]. 

Calculating the DTFT of both sides of the equation, we obtain 


Y(ft) = X(ft)H(ft) ( 11 . 54 ) 

or 

Y(H) 

Hin) =mr (1L55) 

where Y(fi) and X(ft) are, respectively, the DTFTs of the output response y[k] 
and the input signal x[k], Equation ( 11 . 55 ) provides an alternative definition 
for the transfer function as the ratio of the DTFT of the output signal and the 
DTFT of the input signal. 

Given one representation for an LTID system, it is straightforward to derive 
the remaining two representations based on the DTFT and its properties. In the 
following, we derive a formula to calculate the transfer function of an LTID 
system from its difference equation representation. 

Consider an LTID system whose input-output relationship is given by the 
following difference equation: 

y[k + n] + a n _iy[k + n — 1] -| b a 0 y[k] = b m x[k + m] 

+ b m -\x[k + m — 1 ] + ■ • • + box[k], ( 1 1 . 56 ) 

Calculating the DTFT of both sides of the above equation, we obtain 

{e ]nQ + ie j( "- 1)12 + • • • + a 0 }Y(f2) = [b m ^ Q + 

+ • • • + bo} 


which reduces to the following transfer function: 


H{Q) = 


Y(0) 

X{Q) 


b m y ,nSi + b, n ^' n - m + ■ • • + b 0 

ei' !fl + fl„_iej ( " _1)fi H b a 0 


(11.57) 


The impulse response h [£] of the LTID system can be obtained by calculating 
the inverse DTFT of the transfer function FI {ft). 
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Fig. 11.16. Impulse response 
h[k] of the LTID system derived 
in Example 11.18. 


2.5 h[k] 



Example 11.18 

The input-output relationship of an LTID system is given by the following 
difference equation: 

y[k + 2] - -y[k + 1] + ly[k] = 2 x[k + 2]. (1 1.58) 

4 o 

Determine the transfer function and the impulse response of the system. 


Solution 

Calculating the DTFT of Eq. (1 1.58) yields 

3 1 1 

e j 2 « _ _ e jfl + y(Q) = 2e j2fi X(l2), 


which results in the following transfer function: 

2e jM 


H(Q) = 


3 • 1 

e j2« _ _ e J« + _ 

4 8 


1 _ -e"^ + -e- j2fl 
4 8 


1 - 1 - -e“ jfi 


To calculate the impulse response of the LTID system, we calculate the partial 
fraction of 7/(12) as follows: 

4 2 

H{0) = j . 

1 - -e- jfi 1 - -e“ jfi 
2 4 


By calculating the inverse DTFT of both sides, the impulse response h[k\ is 
given by 

hlk] = 4 {\) U[k] ~ 2 (l) U[kl 


which is plotted in Fig. 11.16. 


11.7 Magnitude and phase spectra 


The Fourier transfer function / / ( (1) provides a complete description of an LTID 
system. In most cases, 7/(12) is a complex function of the angular frequency 12. 
Therefore, it is difficult to analyze the frequency characteristics of the transfer 
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Fig. 11.17. Gain and phase 
responses of an LTID system. 

The LTID system provides a gain 
of \H (0)\ to the magnitude and 
a phase change of <H (T2) to the 
phase of the sinusoidal input. 


*[*] = 
cos(T2 0 £) 


LTID system 


► 


H(C2) 


* y[k] = \H(n 0 )\cos(£2 0 k + <H(£2 0 )) 


function directly from the mathematical expression. By expressing the transfer 
function H(ft) as 


H(ft) = \H{ft)\^ <ms} \ 


(11.59) 


the LTID system is analyzed by plotting the magnitude \H(ft)\ and phase 
<H{ft) as functions of frequency ft. The plot of the magnitude H (J?)| with 
respect to frequency ft is referred to as the magnitude spectrum, while the plot 
of the phase <H(ft ) with respect to frequency ft is referred to as the phase 
spectrum. Collectively, magnitude and phase spectra are used to analyze the 
LTID system. 

A second interpretation of the magnitude and phase spectra is obtained by 
considering a sinusoidal sequence x | k ] = cos(l?o k) applied at the input of an 
LTID system with transfer function H(ft). The DTFT of the output of the LTID 
system is given by 

Y(ft) = %{x[k]}H(ft) 

= n[S(ft - 17 0 ) + 8{ft + C 0 )]|//(C)|e j<ff(fi) 

= 7t[S(ft- ft 0 )\H(ft 0 )\ei <HW + 8{ft + Co)|//(-C 0 )|e j< " ( - no) ]. 

Assuming that the impulse response h[k] of the LTID system is real-valued and 
then applying the Hermitian symmetry property, we observe that the magnitude 
response \H(ft)\ is an even function of ft while the phase response <11 (ft) is 
an odd function of ft. Mathematically, 


\H(-ft)\ = \H{ft)\ and <H{-ft) = - <H(ft). 


The DTFT Y {ft) of the output of the LTID system is therefore given by 
Y{ft) = jr\H(fto)\[8(ft — fto)e^ <H( ' n ° ) + S(C+ C 0 )e-j <H(fio) ]. 
Calculating the inverse DTFT, the output of the LTID system is given by 

y [k] = ^ | H(fto) | [ e j (fio<:+<ff(fio)) + e -j(«o*+<ff(«o))] (11.60a) 

or 


y[k\ = \H{ft Q )\ cos(ft 0 k+ <H(ft 0 )). (11.60b) 

Figure 1 1.17 is a schematic diagram of the gain and phase changes in the sinu- 
soidal input caused by an LTID system. Computed at the fundamental frequency 
ft — fto of the sinusoidal input, the magnitude \H(ft)\ of the transfer function 
determines the gain introduced by the LTID system, while the phase <H{ft) at 
ft — fto determines the phase change in the applied sinusoidal sequence. The 
magnitude \H{ft)\ and phase <// (ft) are therefore also referred to as the gain 
and phase responses of the LTID system. 
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Example 11.19 

Plot the magnitude and phase spectra of the LTID system specified in 
Example 11.18. 


Solution 

From Example 11.18, the transfer function of the LTID system is given by 


77(17) = 




Using Euler’s formula exp(jl7) = cos 17 + j sin 17 and similarly for exp(j217), 
yields 


7/(17) = 


3 1 

1 — - cos 17 + - cos(2l7) + j 


3 1 

- sin 1? sin(2l?) 

4 8 


which leads to the following expressions for the magnitude and phase responses: 
\H(Q)\ = 


/ r 3 1 

2 

r 3 

1 1 

1 cos Q H — cos(2i?) 

4 8 

+ 

- sin u - 
_4 

- - sin(2l7) 


101 27 1 

cos 17 H — cos(2l7) 

64 16 ' 4 y 


<H((7) = < 2- < 


= — tan 


3 1 

1 cos 17 H — cos(2l7) + i 

4 8 

3 1 

- sin 17 sin(217) 

4 8 

3 1 

1 cos 17 H — cos(2l7) 

4 8 


3 1 

- sin 17 sin(2l7) 

4 8 


Figures 1 1.18(a) and (b) plot the magnitude and phase spectra in the frequency 
range 17 = [—n, n]. Because the DTFT is periodic with period l7o = 2 tt, the 
magnitude and phase spectra at other frequencies can be calculated using the 
periodicity property. It is observed that the gain |/7(17)| of the LTID system 
has the maximum value of 16/3 at frequency 17 = 0. The gain // ( 17) at 17 = 0 
is also referred to as the dc component of the impulse response h[k], and is 
the sum h[k] over the duration of the impulse response. As the frequency 
increases to n (or decreases to — tt), the gain decreases monotonically and has 
a minimum value of 16/15 at 17 = ±7T radians/s. For LTID systems, the fre- 
quency 17 = ±7T radians/s corresponds to the maximum frequency. The trans- 
fer function 7/(17) represents a non-uniform amplifier as the lower-frequency 
components are amplified at a relatively higher scale than the high-frequency 
components. 

The phase response <7/(17) of the LTID system has a value of zero at 17 = 0. 
As the frequency increases from zero, the phase decreases to its minimum 
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Fig. 11.18. (a) Magnitude 
spectrum and (b) phase 
spectrum of the LTID system 
considered in Example 11.19. The 
responses are shown in the 
frequency range Q = [-x. x]. 


value of -0.2457T radians at 12 = 0.37 tt radians/s. From ft = 0.31 tt radians/s to 
ft — 7T radians/s, the phase increases and approaches zero at ft = Tt radians/s. 
For negative frequencies, the phase increases to its maximum value of 
0.245 it radians at Q = — 0.37tt radians/s, after which the phase decreases and 
approaches zero at ft — —it radians/s. 

It is also observed that the transfer function H(ft) satisfies the Hermitian 
symmetry property stated in Eq. (1 1.39a). Since the impulse response h[k] is a 
real-valued function, the magnitude spectrum \H(ft)\ is an even function of ft 
and is therefore symmetric about the y-axis in Fig. 11.1 8(a). On the other hand, 
the phase spectrum <H(ft) is an odd function of ft and is therefore symmetric 
about the origin in Fig. 1 1.18(b). In cases where the impulse response h[k] is a 
real- valued function, the plots in the range ft — [0, zr] are sufficient to represent 
the frequency response completely. The frequency response within the range 
ft — [ —tt, 0] can then be obtained using the Hermitian symmetry property. 


Example 11.20 

Derive and plot the frequency responses of the LTID systems with the following 
impulse responses: 


(i) 

(ii) 


h[k] = 


s,m{nk/6) 


jtk 


g [k) = m - 


sin(7r£/6) 
Ttk 


(11.61) 

(11.62) 


Solution 

(i) We express li[k] as a sine function as Ii [k] = 


1 sin(7rA:/6) 
6 jtk/6 


Using Table 1 1 .2, the transfer function is given by 


1 

- sinc(£/6). 

6 


H(ft) = 


1 

0 


\ft\ < 7T/6 
tt/ 6 < \ft\ < Tt. 


(11.63) 


The impulse response h[k] and its magnitude spectrum \H(ft)\ are plotted in 
Figs. 1 1 . 19(a) and (b) within the frequency range ft = [0, tt]. Since the transfer 
function H(ft) is real-valued, the phase spectrum is zero. The transfer function, 
Eq. (11.63), or equivalently the impulse response, Eq. (11.61), represents an 
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Fig. 11.19. (a) Impulse response 
h[k] and (b) magnitude 
spectrum \H(Q)\ of an ideal 
lowpass filter specified in 
Example 11.20(i). The phase 
response is zero for all 
frequencies. 


ideal lowpass filter since the low-frequency components in the input sequence, 
which lie within the range 0 < ft < zr/6, are passed through the system without 
attenuation. On the other hand, the higher-frequency components within the 
range 7 t/6 < (2 < jt are completely blocked. Lowpass filters are widely used 
in digital signal processing and will be considered in more detail in Chapter 14. 

(ii) Expressing the impulse response g\k] in terms of the impulse response 
h[k) given in part (i), we obtain 


g[k] = S[k]-h[k]. 

Using the linearity property, the transfer function of g [ k ] is given by 


G(( 7) = 1 - H(G). 


Substituting the value of 7/(17) from Eq. (1 1.63) yields 


G{f!) = 


0 

1 


| J?| < it/6 
7T/6 < \fi\ < Jt. 


(11.64) 


The impulse response g[&] and its magnitude spectrum |G(17)| are plotted in 
Figs. 1 1.20(a) and (b). It is observed that the low-frequency components within 
the range 0 < 12 < it /6 are completely blocked from the output, while the high- 
frequency components within the range jt /6 < 12 < it are passed through the 
system without any attenuation. Such a system is referred to as an ideal highpass 
filter. Like lowpass filters, the highpass filters are also widely used in digital 
signal processing, and will be considered in more detail in Chapter 14. 


In the previous example, we considered calculating the magnitude and phase 
spectra of an LTID system. The following example illustrates how the spectra 
may be used to calculate the output of an LTID system for elementary sinusoidal 
sequences. 


Example 11.21 

A continuous-time audio signals (?) = 3 cos(10007T?) + 5 cos(20007rf)is sam- 
pled at a sampling rate of 8000 samples/s to produce the DT sequence x[k}. 
Calculate the output signals if the DT signal x[k ] is applied at the input of an 
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0.8333 


(a) 



Fig. 11.20. (a) Impulse response 
h[k] and (b) magnitude 
spectrum | H (T2)| of an ideal 
highpass filter specified in 
Example 11.20(ii). The phase 
response is zero for all 
frequencies. 


LTID systems with the following transfer functions: 

(i) Hm = 


(ii) 7/ 2 (72) = 


1 _ + -e” jM 

4 8 

i \n\ < \ 

: r 

0 — < \f2\ < 7t, 

6 


(iii) // 3 (72) = 


0 \n\<^ 

i r ^ 

1 — < |T2| < 71 . 

6 


(11.65) 


( 11 . 66 ) 


(11.67) 


Solution 

The DT sequence x[k] is given by 

x[k~\ = x(kT s ) = 3 cos(10007tA: 7 , s ) + 5 cos(2000jt^ 7’ s ). 


Substituting T s = 1 /8000, we obtain 

( irk 

x[k] = 3 cos — 


'irk 
5 cos I — 


which implies that x[k ] consist of two frequency components, 1?! = 7 t/ 8 and 
72 2 = 7r/4. This is also apparent from the DTFT of x[k], given by 

x(f2) = 3jt [5 ( 72 - + s (72 + |)] + 5 Jr [a + a (f?+ 


which consists of impulses at frequencies = ±7r/8 and 72 2 — ±tt/4. 

As the DTFT is 2zr -periodic, in the above equation we showed A (72) only 
in the frequency range —tc < 72 < n . This simplifies the analysis, and hence 
we will use the same approach to express the DTFTs in the following. 

If the transfer function of an LTID system is 7/(12), the DTFT 7(7 2) of the 
output sequence is given by 


7(72) = 7/(72)X(72) 

= 77(72) 3tt [5(72- +5(72+ |)] + 5tt [s(t2- ^)+s(t2+ J)] 

+ 5,[ S (ft-T)//(T) +J (fl + T)„(-T)]. 
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The DTFT Y (12) is obtained by substituting the values of the transfer function 
H(0) at frequencies 12 1 = ±7r/8 and J?2 = ±jt/4. 

(i) For the transfer function in Eq. (1 1.65), the values of H\(Q) are given by 


0 = 71/8 Hi(n/8) = 4.04 — j2.03, IZ/j ( tt/8)| = 4.52, < //(tt/8) = -0.465 radians; 

O = — 7r/8 = 4.04 + j2.03, /8)\ = 4.52, < //(-jr/8) = 0.465 radians; 

O = ;r/4 H 1 (ji/4) = 2.44 -j2.11. I/Zj (?r/4)| = 3.22, < //(jr/4) = -0.71 radians; 

O = —n/4 = 2.44 + j2. 1 1 . |// 1 (-^/4)| = 3.22, 4) = 0.71 radians. 

The DTFT Fi(l2) of the output sequence is therefore given by 

Y^O) = 3t r [<$ 4.52e“ j0 ' 465 + 5 + |) • 4.52e j0465 j 

+ tt 5 [<5 (l2 - ^) 3.22e- j0 ' 71 + <5 (7/ + 0 3.22e j0 ' 71 j 
= 13.56tt [<$ (f2 - ^) e - j0 - 465 + S (o + |) e j0 ' 465 j 
+ 16.107T [5 (o - ^) e- j0 ' 71 + <5 (d + e 50 71 ] . 

Calculating the inverse DTFT, the output sequence is obtained as 

yi[k] = 13.56 cos Qk - 0.465) + 16.10 cos (J^k - 0.7l), 

where we have expressed the constant phase in radians. Expressing the constant 
phase in degrees yields 

yi[k] = 13.56 cos - 26.67°) + 16.10 cos (^k - 40.80°). 

The LTID system H\(0) acts like an amplifier as the sinusoidal component 
3 cos(7rA:/8) with fundamental frequency Q\ = 7r/8 is amplified by a factor 
of 4.52, while the sinusoidal component 3 cos(jxk/A) with fundamental fre- 
quency 0 1 = jr/4 is amplified by a factor of 3.22. The difference in the gains 
is also apparent in the magnitude spectrum plotted in Fig. 11.18, where the 
low-frequency components have a higher amplification factor than that of the 
higher-frequency components. 

(ii) For the transfer function in Eq. ( 1 1 .65), the values of the transfer function 
//2(C) at frequencies O \ = ±7r/8 and 0 2 = ±7r/4 are given by 

O — tx/8 H 2 (tx/8)=L \H 2 (jx/8)\ = 1, <7/2(71/8) = 0 radians; 

12 = — ?r/8 /+( — 7r/8) = 1, \Hn{ — 7r/8)| = 1, <H 2 (—7x/8) = 0 radians; 

O — tv /A H 2 (tt/A) = 0, \H 2 (tt/A)\ = 0, <7/2(71/4) = 0 radians; 

O = — jr/4 H 2 (—jx/A) = 0, |//2 (— tt/4)| = 0, <H 2 {—tx /A) = 0 radians. 
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The DTFT Y 2 (<i) of the output sequence is therefore given by 

Y 2 (n) = 3jt[«(/2- !)• i + a(/ 2 + !)• l] 

+ 5^[a(j7- -0 + <$(f2 + J).o] 

= 3n [«(« -|) + «(«+ Di- 


Calculating the inverse DTFT, the output sequence is obtained as 

y 2 [k] = 3 cos (D)' 


The LTID system H 2 (fi) acts like an ideal lowpass filter as the sinusoidal 
component 3 cos(7rk/8) with low fundamental frequency fl\ = tt/8 is not 
attenuated, while the sinusoidal component 3 cos(7rk/4) with high fundamental 
frequency Q\ — tx /4 is blocked from the output. 

(iii) For the transfer function in Eq. (11.67), the values of the transfer 
function H 2 (H) at frequencies Q i = ± tt/8 and fl 2 = ±tt/ 4 are given by 


J? = tt/8, 7/3(71/8) = 0, 

fi= — 7r/8, // 3 ( — 7t /8) = 0, 
J? = tt/4, H 2 (tt/4) = 1, 

f2 = — 7t/4, // 3 (— Jt/4) = 1, 


1 ^ 3 ( 71 / 8)1 = 0 , 
|// 3 (-7T/8)| = 0, 

|// 3 (7T/4)| = 1, 
|// 3 (-:r/4)| = 1, 


<// 3 (jr/8) = 0 radians; 
<// 3 (— 7r/8) = 0 radians; 
<// 3 (jr/4 ) = 0 radians; 
<// 3 (— 7r/4) = 0 radians. 


The DTFT y 3 (l?) of the output sequence is therefore given by 
Y 2 {Q) = 37t^/2- D • 0 + 5(72 + ' °] 

+ 5 *K«- j) ■!+*(«+ j) * 1 2 3 4 ] 

Calculating the inverse DTFT, the output sequence is obtained as 

y 3 [k] = 5 cos (D)- 

The LTID system // 3 (f2) acts like an ideal highpass filter as the sinusoidal com- 
ponent 3 cos(7rA:/8) with lower fundamental frequency l?i = it 18 is blocked, 
while the sinusoidal component 3 cos(7r k/8) with higher fundamental frequency 
t?i = 7 t/ 4 is unattenuated in the output sequence. 


11.8 Continuous- and discrete-time Fourier transforms 


In Chapters 4, 5, and 10, we derived frequency representations for CT and DT 
waveforms. In particular, we considered the following four frequency represen- 
tations: 

(1) CTFT for CT periodic signals; 

(2) CTFT for CT aperiodic signals; 

(3) DTFT for DT periodic sequences; 

(4) DTFT for DT aperiodic sequences. 
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In this section, we compare the Fourier transforms for different types of signals. 
The CT periodic signals are typically represented by the CTFS, 

OO 

x(t)= A,e j "“° f , 

n=—o o 

where D n denotes the CTFS coefficients and coq is the fundamental frequency 
of the CT periodic signal. By exploiting the CTFT pair 

CTFT 

e J«£O 0 ' ^ ^ 2 7 t 8 (cO — nco o), 
the CTFT for the CT periodic signals is given by 
CTFT 

x(t) < > X(cu) = 2 it D n 8(co — nu>o) 

n=—o o 

and consists of a train of time-shifted impulse functions. In other words, the 
CTFT of CT periodic signals is discrete in nature. 

For CT aperiodic signals, the CTFT XicS) is given by 

OO 

x(t ) < CTFT > X(a>) = J x(r)e _ j" , dt, 

— OO 

which is generally aperiodic and continuous in the frequency domain. 

Similar to the CT periodic signal, the frequency representation for a DT 
periodic sequence is obtained by using the following DTFS: 

x[k] = D„e inSlok , 

n=(K 0 ) 

where D„ denotes the DTFS coefficients and _<7 0 is the fundamental frequency 
of the DT periodic signal. We observed that the DTFS is periodic with period 
Kq = 2n / Q q such that 


D/i — Dn+mKo 

for — oo < m < oo. By exploiting the DTFT pair 

ei"" 0 * < DTFT > 2Tx8{Q-nQ 0 ), 
the DTFT for a DT periodic sequence is given by 

OO 

x[k] < DTFT > X{Q) — 2: x Y\ D n 8{fi — nflo). 

n = — oo 

We showed that the DTFT of a DT periodic sequence is discrete as it consists of 
several discrete time-shifted impulse functions. In addition, the DTFT of a DT 
periodic sequence is itself periodic in the frequency domain, with a fundamental 
period l?o = 27T. 

Finally, the DTFT of a DT aperiodic sequence is given by 

OO 

X{H)= Y x[k]e~ if>k . 

k — — oo 
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Table 11.7. Fourier transforms for different types of waveforms 


Time domain 


Frequency domain 


x{t)\ continuous and periodic signals 


X(f2)\ discrete and aperiodic CTFT 



(a) 



X(Q)\ Continuous and aperiodic CTFT 


1 


-wow 


► <o 


(b) 


x[k\\ discrete and periodic signals 


X(fl)\ discrete and periodic DTFT 


• — • — — — — • — • — — — — • — • — — — — • — • — ►A -2k -k 0 n 2 k 

-8 -6 -4 -2 0 2 4 6 8 

(c) 


x[k\. discrete and aperiodic signals 


1 1 1 


->A 


-6 -4 


(d) 
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We observed that the DTFT of a DT aperiodic sequence is continuous as it is 
defined for all frequencies Q. Like the DTFT of a DT periodic sequence, the 
DTFT of a DT aperiodic sequence is periodic in the frequency domain, with a 
fundamental period Qq — 2n . 

The aforementioned discussion on the four types of Fourier transforms is 
summarized in Table 11.7, where we observe that periodicity in the time 
domain corresponds to discreteness in the frequency domain. The CTFT 
for the CT periodic signals, illustrated in row (a) of Table 11.7, and the 
DTFT for the DT periodic signals, illustrated in row (c), are both dis- 
crete in the frequency domain. The converse of the observation is also true, 
as discreteness in the time domain corresponds to periodicity in the fre- 
quency domain. The converse statement is illustrated in rows (c) and (d), 
where periodic and aperiodic DT sequences are considered. The DTFT for 
both the periodic and aperiodic DT sequences is periodic with period Q o = 


When a signal is both discrete and periodic in the time domain, such as the DT 
periodic sequence illustrated in row (c) of Table 1 1 .7, the DTFT is also both 
periodic and discrete in the frequency domain. This observation is exploited 
in digital signal processing. To compute the DTFT on digital computers, it 
is always assumed that the waveform is discrete and periodic, even when the 
original waveform is neither discrete nor periodic. Chapter 12 presents the 
theory of the discrete Fourier transform (DFT), which is a very powerful tool 
for computing the CTFT and DTFT. 


In this chapter, we presented the frequency representation for DT sequences. 
For aperiodic sequences, we derived the DTFS, which is defined as 


where Co is the fundamental frequency, given by Co = 2tx /Kq, and the discrete- 
time Fourier series (DTFS) coefficients D n , for 1 <n< Kq, are given by 


The DTFS coefficients of periodic sequences are themselves periodic with a 
period Kq such that 


2tt. 


11.9 Summary 


x[k]= D„^ nn ° k 


n=(K 0 ) 



D n — D n +mK.Q for 171 G Z. 
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Section 11.2 derived the DTFT for an aperiodic sequence x[k ] as follows: 

DTFT synthesis equation x[k] — — [ X(f2)e* kn df2 m , 

2 ji J 

(2n) 

oo 

DTFT analysis equation X((7) = x[ k\sT^ nk , 

k=—o o 


and showed that the DTFT is periodic in the frequency domain with a period 
= 2 n. As such, the frequencies Q = 0, 2n, 4n, . . . are considered as the 
same frequencies and are referred to as the lowest possible frequency for 
the DTFT. Similarly, the frequencies fi = it, 3tt, 5tt, ... are the same and are 
referred to as the highest possible frequency for the DTFT. 

Section 1 1 .3 derived a sufficient condition for the existence of the DTFT for 
aperiodic DT sequences as follows: 

OO 

y, \X 2 [k\\ < oo. 

k=—o o 


The periodic DT sequences do not satisfy the above condition for the existence 
of the DTFT. Instead the DTFT of a periodic sequence is obtained by calcu- 
lating the DTFT of its DTFS representation, which results in the following 
DTFT: 


X(f2) = 2 tt 


OO 

E M 


2 mr 

n 


K 0 


)■ 


where D„ are the DTFS coefficients of the periodic sequence x[k~\. 

Section 1 1 .4 covered the properties of the DTFT. In particular, we covered 
the following properties. 


(1) The periodicity property states that the DTFT of any DT sequence is 
periodic with period 2n . 

(2) The Hermitian symmetry property states that the DTFT of a real-valued 
sequence is Hermitian. In other words, the real component of the DTFT 
of a real-valued sequence is even, while the imaginary component is 
odd. 

(3) The linearity property states that the overall DTFT of a linear combination 
of DT sequences is given by the same linear combination of the individual 
DTFTs. 

(4) The time-scaling property is only applicable for time-expanded (or inter- 
polated) sequences. It states that interpolating a sequence in the time 
domain compresses its DTFT in the frequency domain. 

(5) The time-shifting property states that shifting a sequence in the time 
domain towards the right-hand side by an integer constant m is equiv- 
alent to multiplying the DTFT of the original sequence by a complex 
exponential exp(— j ttm). Similarly, shifting towards the left-hand side by 
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integer m is equivalent to multiplying the DTFT of the original sequence 
by a complex exponential exp(j Qm). 

(6) The frequency-shifting property is the converse of the time-shifting prop- 
erty. It states that shifting the DTFT in the frequency domain towards the 
right-hand side by l?o is equivalent to multiplying the original sequence by 
a complex exponential expfjfio/w). Similarly, shifting the DTFT towards 
the left-hand side by Qq is equivalent to multiplying the DTFT of the 
original sequence by a complex exponential exp(— jJ2o»i). 

(7) The frequency-differentiation property states that differentiating the 
DTFT with respect to the frequency Q is equivalent to multiplying the 
original sequence by a factor of — j k. 

(8) Time differencing is defined as the difference between the original 
sequence and its time-shifted version with a shift of one sample towards 
the right-hand side. The time-differencing property states that time differ- 
encing a signal in the time domain is equivalent to multiplying its DTFT 
by a factor of (1 — exp(— 

(9) The time-summation property is the converse of the time-differencing 
property. The time-summation property states that the DTFT of the run- 
ning sum of a sequence is obtained by dividing the DTFT of the original 
sequence by a factor of (1 — exp(— jl?m)) and adding DT impulses located 
at multiples of 2 n . 

(10) The time-convolution property states that the convolution of two DT 
sequences is equivalent to the multiplication of the DTFTs of the two 
sequences in the time domain. 

(11) Periodic convolution is an extension of time convolution to periodic 
sequences, where only single periods of the two periodic sequences are 
convolved. The periodic-convolution property states that the periodic con- 
volution in the time domain is equivalent to multiplying the DTFS coef- 
ficients of the two periodic sequences by each other in the frequency 
domain. 

(12) The frequency-convolution property states that periodic convolution of 
two DTFTs with period 2 jv is equivalent to multiplication of their 
sequences in the time domain. 

The DTFT of the impulse response of an LTID system is referred to as the Fourier 
transfer function, which is generally complex-valued. The plot of the magnitude 
of the Fourier transfer function with respect to frequency Q is referred to as the 
magnitude spectrum, while the plot of the phase of the Fourier transfer function 
with respect to frequency ft is referred to as the phase spectrum. Sections 1 1.6 
and 11.7 illustrated how the magnitude and phase spectra provide meaningful 
insights into the analysis of the LTID systems. In particular, we covered the ideal 
lowpass filter, which blocks all frequency components above a certain cut-off 
frequency Q > in the applied input sequence. All frequency components 
Q < are left unattenuated in the output response of an ideal lowpass filter. 
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The magnitude spectrum of an ideal lowpass filter is unity within its pass band 
(17 < l? c ) and zero within its stop band (17 c < 17 < 7r). 

The converse of the ideal lowpass filter is the ideal highpass filter, which 
blocks all frequency components below a certain cut-off frequency 17 > 17 C in 
the applied input sequence. All frequency components 17 > 17 C are left unatten- 
uated in the output response of an ideal highpass filter. The magnitude spectrum 
of an ideal highpass filter is unity within the pass band (17 C < 17 < 7r) and zero 
within the stop band (0 < 17 < 17 C ). 

Section 11.8 compared the Fourier representations of CT and DT periodic 
and aperiodic waveforms. We showed that the Fourier representations of peri- 
odic waveforms are discrete, whereas the Fourier representations of discrete 
waveforms are periodic. 


Problems 


11.1 Determine the DTFS representation for each of the following DT peri- 
odic sequences. In each case, plot the magnitude and phase of the DTFS 
coefficients. 

(i) x[k] = k for 0 < k < 5 and x[k + 6] = x[k\, 
f 1 (0 < k < 2) 


(ii) x[k] = 


0.5 

0 


(3 <k< 5) 
(6 <k< 8) 


and x[k + 9] = x[k]\ 


( 2 TT 7t 

— -k + — 

(iv) x[k] = 2 e j (T*+T); 

OO 

(v) x[k] = &(k — 5m); 


(vi) x[k ] = cos(10ttA:/ 3) cos(27r£/5); 

(vii) x[k ] = |cos(27tA:/3)| . 


11.2 


D 


n+ 9 


= D„ 


Given the following DTFS coefficients, determine the DT periodic 
sequence in the time domain: 

1 (0 < k < 2) 

0.5 (3 < k < 5) and 

0 (6 < k < 8) 

l-j0.5 (n = — 1 ) 

1 (n = 0) 

l+j0.5 (n=\) 

0 (2 < n < 5) 


(i) D n = 


(ii) A, = 


and Ai+7 = A 


3 /Tcn\ 

(m) D n = \ + - sin ( — J (0 < n < 6) and D n+1 = D„; 

(iv) D n = (— 1)" (0 < « < 7) and D„ +s = Ad 

(v) D„=ej"^ 4 (0 < n < 7) and D n+ $ = D n . 
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(ii) x[k] = 


11.3 Determine if the following DT sequences satisfy the DTFT existence 
property: 

(i) x[k] - 2; 

'3 — |A:| |*| < 3 

0 otherwise; 

(iii) x[k] = *3-'* 1 ; 

(iv) x[k ] = a k cos(a>ok)u[k], |a| < 1; 

(v) x[k ] = a k sin(&>(* + <P)u[k], |a| < 1; 
sin(7rA:/5) sin(7rA:/7) 


(vi) m = nV 

OO 

(vii) x[k\ = &{k — 5m 


3); 


(viii) x[k ] = 


m =— oo 

3 — |*| |*| < 3 

0 |*| = 3 

(ix) x[k] = e j( a2lri + 45 °); 

(x) x[k] = k3~ k u[k] + e^°- 2nk + 45 ^ 


and x[k + 7] = jc [*]; 


11.4 (a) Calculate the DTFT of the DT sequences specified in Problem 1 1.3. 
(b) Calculate the DTFT of the periodic DT sequences specified in 

Problem 11.1. 

11.5 Given the following transform pair: 


DTFT , r ,. DTFT 

x \ [*] •< Xi(f2) and X 2 [*] < > X 2 (ft)’ 


express the DTFT of the following DT sequences in terms of the DTFTs 
Xi(f2) and X 2 (fl): 

(i) (-1 fxdk]-, 

(ii) (k — 5) 2 X2[k — 4]; 

(iii) ke^ 4k x\ [3 - k]; 

OO 

(iv) ^ [x\ [k — 4m] + x 2 [k — 6m]]; 

m =— oo 

(V) Xl [5 - k]x 2 [l - k]. 


11.6 


Calculate the DT sequences with the following DTFT representations 
defined over the frequency range — jt < 12 < tv. 

4 e -i« 


(i) *(12) = 


1 — 5e - i fi + 6e - i 2fi ’ 


2e“ j2fi 

(U) X{iI) = (1 -4e-j«) 2 (l - 2e~i ft ) ’ 


(iii) X(12) = 8 sin(712)cos(912); 


(iv) X(12) = 


4e -i 4 « 

10 — 6 cos 12’ 

1 0.25t r < |12| < 0.75 tt 

0 |12| < 0.25t r and 0.75 jt < |12| < n. 


(v) X(12) = 
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11.7 (a) Prove the Hermitian symmetry property, Eq. (11.39a), for a real- 

valued DT sequence. 

(b) Problem 11.6 lists the DTFTs of several sequences. Applying the 
Hermitian property, determine whether these sequences are real- 
valued. 

11.8 Prove the frequency-differentiation property of the DTFT. 

11.9 Prove the time-convolution property of the DTFT. 

11.10 Prove the time-shifting property of the DTFT. 

11.11 Given the following transfer function: 

1 

H(fi) = ; T — 

(1 - 0.3e-J fi )(l - 0.5e-J«)(l - 0.7e~J«) 

(i) determine the impulse response of the FTID system; 

(ii) determine the difference equation representation of the LTID 
system; 

(iii) determine the unit step response of the FTID system by using the 
time-convolution property of the DTFT; 

(iv) determine the unit step response of the LTID system by convolv- 
ing the unit step sequence with the impulse response obtained in 
part (i). 

11.12 Given the following difference equation: 

y[k] + y[k - 1] + 1 y [k - 2] = X[k] - X[k - 2], 

(i) determine the transfer function representing the LTID system; 

(ii) determine the impulse response of the LTID system; 

(iii) determine the output of the LTID system for the input x[k\ — 
(l/2) k u[k] using the time-convolution property; 

(iv) determine the output of the LTID system by convolving the input 
x[k] = (1/2 ) k u[k] with the impulse response obtained in part (ii). 

11.13 Determine the output response of the LTID systems with the specified 

inputs and impulse responses using Fourier transform approach: 

(i) x[k] = u[k] and li[k] = 4~ w ; 

(ii) x[k] = 2~ k u[k] and h[k] = 2 k u[-k - 1]; 

(iii) x[k] = u[k] — u[k — 9] and h[k] = 3 k u[-k + 4]; 

(iv) x[k] = k5~ k u[k] and h[k] = 5 k u[-k]\ 

(v) x[k] = u[k + 2] — u[— k — 3] and h[k\ = u[k — 5] — n [— k — 6]. 

11.14 Given that the transfer function of an LTID system is given by 

1 

(l + 3e-i fi )’ 


H{Q) = 
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determine and sketch the following as a function of frequency Q over 
the range — n < Q < rr. 

(i) Re{//(f2)}; (hi) \H(0)\-, 

(ii) Im {H(0)}\ (iv) 

11.15 Calculate and plot the magnitude and phase spectra of the LTID systems 
specified in Problem 11.13. 

11.16 The impulse response of an LTID system is given by 

h[k] = 38[k + 3] - 28[k + 2] + S[k + 1] + 58[k] 

- 8[k - 1] - 2 8[k - 2] - 38[k - 3] + 48[k - 4], 


Without explicitly determining the transfer function 1 1(0), evaluate the 
following using the properties of the DTFT: 

(i) H(O)\ n=0 ; 

(ii) H(H) In^; 

(iii) <H(0)\ 

(iv) I H(i 2)dO. 

J —7T 

(v) Determine and sketch the DT sequence with the DTFT H(— 17). 

(vi) Determine and sketch the DT sequence with the DTFT R e { H (f2)\. 

11.17 Using Parseval’s theorem, determine the following sum: 

sin(:rA:/5) sin(jtk/l) 


11.18 Consider an LTID system with the following impulse response: 


E 


h[k] = sinc(3&/4). 


Determine the output responses of the LTID system for the following 
inputs: 

(i) x[k ] — cos(l ljrfc/16) cos(37rA:/16); 


(ii) x[k] = k for 0 < A: < 5 


(iii) x[k] = 


1 

0.5 

0 


(0 < k < 2) 
(3<k<5) 
(6 < k < 8) 


and x [k + 6] = x [A:] ; 
and x[k + 9] = x[k]\ 


OO 

(iv) x[k ] = ^ 8(k — 5 ;«); 

m = — oo 


(v) x[k ] = sinc(A:/3). 


11.19 When the DT sequence 


x[k] =4~ k u[k] + 3~ k u[k] 
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is applied at the input of an LTID system, the output response is given 
by 


(i) Determine the Fourier transfer function H{(7) of the LTID system. 

(ii) Determine the impulse response h[k] of the LTID system. 

(iii) Determine the difference equation representing the LTID 
system. 

(iv) Determine if the system is causal. 

11.20 Repeat Example 11.21 for each of the following signals, assuming that 
the sampling rate to discretize the CT signals is 8000 samples/s: 

(i) x\{t) — 2 + 3 cos(400jrf) + 7 cos(800tt t); 

(ii) * 2 (?) — 2cos(4000tt 0 + 5 cos(60007rf); 

(iii) x-i (t) = 5 cos(600;rr) + 9 cos(9007rr) + 2 cos(3000jrf); 

(iv) X 4 (?) — 4cos(600 irt) + 6cos(12000jrf). 

11.21 Repeat Example 1 1.21 for each of the following signals, assuming that 
the sampling rate to discretize the CT signals is 22000 samples/s: 

(i) Xi(?) = 2 + 3 cos(80 007rf) + 7 cos(18 OOOirt); 

(ii) X 2 (t) = 2 cos(10 0007Tf) + 5 cos(30 OOOirt); 

(iii) * 3(0 = 5 cos(600jrt) + 9 cos(9007Tt) + 2 cos(3000jrf); 

(iv) X 4 (t) = 4cos(28 0007rf) + 6 cos(18 OOOirt). 



CHAPTER 



Discrete Fourier transform 


In Chapter 1 1 , we introduced the discrete-time Fourier transform (DTFT) that 
provides us with an alternative representation for DT sequences. The DTFT 
transforms a DT sequence x[k ] into a function X(f}) in the DTFT frequency 
domain I?. The independent variable Q is continuous and is confined to the 
range -n < i? < n. With the increased use of digital computers and special- 
ized hardware in digital signal processing (DSP), interest has focused around 
transforms that are suitable for digital computations. Because of the continuous 
nature of f2, direct implementation of the DTFT is not suitable on such digital 
devices. This chapter introduces the discrete Fourier transform (DFT), which 
can be computed efficiently on digital computers and other DSP boards. 

The DFT is an extension of the DTFT for time-limited sequences with an 
additional restriction that the frequency 12 is discretized to a finite set of values 
given by 12 = 2jtr/M, for 0 < r < ( M — 1). The number M of the frequency 
samples can have any value, but is typically set equal to the length N of the time- 
limited sequence x[k]. If M is chosen to be a power of 2, then it is possible to 
derive highly efficient implementations of the DFT. These implementations are 
collectively referred to as the fast Fourier transform (FFT) and, for an M-point 
DFT, have a computational complexity of OfMlogjM). This chapter discusses 
a popular FFT implementation and extends the theoretical DTFT results derived 
in Chapter 1 1 to the DFT. 

The organization of this chapter is as follows. Section 12.1 motivates the 
discussion of the DFT by expressing it as a special case of the continuous-time 
Fourier transform (CTFT). The formal definition of the DFT is presented in 
Section 12.2, including its matrix-vector representation. Section 12.3 applies the 
DFT to estimation of the spectra of both DT and CT signals. Section 12.4 derives 
important properties of the DFT, while Section 12.5 uses the DFT as a tool to 
convolve two DT sequences in the frequency domain. A fast implementation of 
the DFT based on the decimation-in-time algorithm is presented in Section 12.6. 
Finally, Section 12.7 concludes the chapter with a summary of the important 
concepts. 
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12.1 Continuous to discrete Fourier transform 


In order to motivate the discussion of the DFT, let us assume that we are 
interested in computing the CTFT of a CT signal x(t ) using a digital computer. 
The three main steps involved in the digital computation of the CTFT are 
illustrated in Fig. 12.1. The waveforms for the CT signal x(t) and its CTFT 
X(co), shown in Figs. 12.1(a) and (b), are arbitrarily chosen, and hence the 
following procedure applies to any CT signal. A brief explanation of each of 
the three steps is provided below. 


Step 1: Analog-to-digital conversion In order to store a CT signal into a 
digital computer, the CT signal is digitized. This is achieved through two pro- 
cesses known as sampling and quantization, collectively referred to as analog- 
to-digital (A/D) conversion by convention. In this discussion, we only consider 
sampling, ignoring the distortion introduced by quantization. The CT signal 
x(t) is sampled by multiplying it by an impulse train: 


OO 

51 (f) = E 8(t — mT\), (12.1) 

m = — oo 


illustrated in Fig. 12.1(c). The sampled waveform is given by 


OO 

x\(t) = x(t)si(t) = x(t) x 8(t — mT\) (12.2) 

m = — oo 


and is shown in Fig. 12.1(e). Since multiplication in the time domain is equiv- 
alent to convolution in the frequency domain, the CTFT X i ((d) of the sampled 
signal x\(t) is given by 


X^co) = 3 


c(f)x 8(t — mT\) 


1 

2: r 


2tt ^ / 

X(a>)*— ^ 3( 8 


- 1 

1 in—— 


= - T x 

T ^ 

1 m — — oo 


2 mn \ 


2mn \ 

~tT). 

(12.3) 


The above result was also derived in Eq. (9.5) of Chapter 9, and is graphically 
illustrated in Figs. 12.1(b), (d), and (f), where we note that the spacing between 
adjacent replicas of X(co) in X ] (o>) is given by 2n/T\. Since no restriction is 
imposed on the bandwidth of the CT signal x(f), limited aliasing may also be 
introduced in X\ (<y). 

To derive the discretized representation of x(t) from Eq. (12.3), sampling is 
followed by an additional step (shown in Fig. 12.1(g)), where the CT impulses 
are converted to the DT impulses. Equation (12.3) can now be extended to 
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Fig. 12.1. Graphical derivation of the discrete Fourier transform pair, (a) Original CT signal, (b) CTFT of the 
original CT signal, (c) Impulse train sampling of CT signal, (d) CTFT of the impulse train in part (c). (e) CT 
sampled signal, (f) CTFT of the sampled signal in part (e). (g) DT representation of CT signal in part (a). 

(h) DTFT of the DT representation in part (g). (i) Rectangular windowing sequence, (j) DTFT of the 
rectangular window, (k) Time-limited sequence representing part (g). (I) DTFT of time-limited sequence in 
part (k). (m) Inverse DTFT of frequency-domain impulse train in part (n). (n) Frequency-domain impulse 
train, (o) Inverse DTFT of part (p). (p) DTFT representation of CT signal in part (a), (q) Inverse DFT of part 
(r). (r) DFT representation of CT signal in part (a). 
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Fig. 12.1. ( cont .) derive the DTFT of the DT sequence x\ [k] as follows: 

OO 

xi[/c] = x(mTi)8(t — mT\). (12.4) 

m=— oo 

Calculating the CTFT of both sides of Eq. (12.4) yields 

OO 

Xj (w)= x(jnT l )eT^ mT \ (12.5) 

m = — oo 

Substituting x\ [m] = x(mT i) and Q — a>T\ in Eq. (12.5) leads to 

OO 

XiM = X 1 (a))U„ /ri = xdm]e~ > m{! , 

m=—o o 
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which is the standard definition of the DTFT introduced in Chapter 11. The 
DTFT spectrum Xi(f7) of x\ [A:] is obtained by changing the frequency axis 
co of the CTFT spectrum X \ (o>) according to the relationship Q — <x)T\. The 
DTFT spectrum X\ (17) is illustrated in Fig. 12.1(h). 


Step 2: Time limitation The discretized signal xi [ A ] can possibly be of infi- 
nite length. Therefore, it is important to truncate the length of the discretized 
signal x\ [A] to a finite number of samples. This is achieved by multiplying the 
discretized signal by a rectangular window. 


1 0<A<(fV-l) 

0 elsewhere, 


( 12 . 6 ) 


of length N. The DTFT X W (Q) of the time-limited signal x w [k ] = xi[A]w[A] 
is obtained by convolving the DTFT Xi(J7) with the DTFT W (Q) of the rect- 
angular window, which is a sine function. In terms of X\(f2), the DTFT X W (S7) 
of the time-limited signal is given by 


X w W) 


1 

2 7T 


*i(fl) 


sin(0.5 NO) m _ 1)/2 

sin(0.517) 


(12.7) 


which is shown in Fig. 1 2. 1 (1) with its time-limited representation x w [A'] plotted 
in Fig. 12. l(k). Symbol 8 in Eq. (12.7) denotes the circular convolution. 


Step 3: Frequency sampling The DTFT X w (f2) of the time-limited signal 
x w [A] is a continuous function of fi and must be discretized to be stored on a 
digital computer. This is achieved by multiplying X w (1?) by a frequency-domain 
impulse train, whose DTFT is given by 


S 2 {Q) = 


2 n 

A 7 




( 12 . 8 ) 


The discretized version of the DTFT X W {Q) is therefore expressed as follows: 


X 2 {0) = X w (f2)S 2 (H) = -i- 
M 


sin(0.5J7) 
2n 


E / Z7tm\ 


(12.9) 


The DTFT X 2 (12) is shown in Fig. 12. 1 (p), where the number M of frequency 
samples within one period (— it < Q < re) of X 2 (12) depends upon the funda- 
mental frequency fl 2 — 2n / M of the impulse train S 2 (f2). Taking the inverse 
DTFT of Eq. (12.9), the time-domain representation X 2 [A] of the frequency- 
sampled signal X 2 (f2) is given by 

OO 

x 2 [k\ = [x w [k]*s 2 [k]] = [xi[k]-w[k]]* 8(k - mM), (12.10) 

m=—oo 


and is shown in Fig. 12.1(o). 
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The discretized version of the DTFT X w (f2) is referred to as the discrete 
Fourier transform (DFT) and is generally represented as a function of the fre- 
quency index r corresponding to DTFT frequency 17, = 2rjt / M , for 0 < r < 
( M — 1). To derive the expression for the DFT, we substitute 17 = 2 rn /M in 
the following definition of the DTFT: 

iV-l 

X 2 (n)= J2 x 2[k]e~ ik{! , (12.11) 

k = 0 

where we have assumed X 2 [k] to be a time-limited sequence of length N . 
Equation (12.1 1) reduces as follows: 

N—\ 

X 2 (f2r) = X 2 [k]e~ i( - 2nkr/M) , (12.12) 

k = 0 

for0< r < (M—l). Equation (12.12) defines the DFT and can easily be imple- 
mented on a digital device since it converts a discrete number N of input samples 
in x 2 [k] to a discrete number M of DFT samples in X 2 (Q r ). To illustrate the 
discrete nature of the DFT, the DFT X 2 (fi r ) is also denoted as X 2 [r \ . The DFT 
spectrum X 2 [r] is plotted in Fig. 12.1 (r). 

Let us now return to the original problem of determining the CTFT X(a>) of 
the original CT signal x(1) on a digital device. Given X 2 [r] = X 2 (.Q r ), it is 
straightforward to derive the CTFT X(a > ) of the original CT signal x(t) by 
comparing the CTFT spectrum, shown in Fig. 12.1(b), with the DFT spectrum, 
shown in Fig. 12. l(r). We note that one period of the DFT spectrum within the 
range — (M — l)/2 < r < ( M — l)/2 (assuming M to be odd) is a fairly good 
approximation of the CTFT spectrum. This observation leads to the following 
relationship: 

X(co r ) « ^ X 2 [r] = ^ E * 2 [k]e-« 2 * kr/M \ (12.13) 

N ^ k = 0 

where the CT frequencies co r = f2 r /T\ = 2 jtr/(M x T\) for — (Af — l)/2 < 
r < (M — l)/2. 

Although Fig. 12.1 illustrates the validity of Eq. (12.13) by showing that the 
CTFT X(oj) and the DFT X 2 \ /] are similar, there are slight variations in the two 
spectra. These variations result from aliasing in Step 1 and loss of samples in 
Step 2. If the CT signal x(t ) is sampled at a sampling rate less than the Nyquist 
limit, aliasing between adjacent replicas distorts the signal. A second distortion 
is introduced when the sampled sequence X\ [k] is multiplied by the rectangular 
window w [k] to limit its length to N samples. Some samples of x \ [&] are lost in 
the process. To eliminate aliasing, the CT signal x(t) should be band-limited, 
whereas elimination of the time-limited distortion requires x{t) to be of finite 
length. These are contradictory requirements since a CT signal cannot be both 
time-limited and band-limited at the same time. As a result, at least one of the 
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aforementioned distortions would always be present when approximating the 
CTFT with the DFT. This implies that Eq. (12.12) is an approximation for the 
CTFT X(a>) that, even at its best, only leads to a near-optimal estimation of the 
spectral content of the CT signal. 

On the other hand, the DFT representation provides an accurate estimate of 
the DTFT of a time-limited sequence x [A'] of length N. By comparing the DFT 
spectrum. Fig. 12.1(h), with the DFT spectrum. Fig. 12.1(r), the relationship 
between the DTFT X 2 (f2) and the DFT X 2 [r] is derived. Except for a factor of 
K / M, we note that X 2 [r] provides samples of the DTFT at discrete frequencies 
fl r = 2 tt r/M, for 0 < r < (M— 1). The relationship between the DTFT and 
DFT is therefore given by 


X 2 (n r ) = ^ X 2 [r ] = ^-Y] X 2 [k]e~ * 2 ” kr ' M) (12.14) 

for fl r = 2nr / M , 0 < r < (M—l). We now proceed with the formal definitions 
for the DFT. 


12.2 Discrete Fourier transform 


Based on our discussion in Section 12.1, the M-point DFT and inverse DFT for a 
time-limited sequence x[k], which is non-zero within the limits 0 < k < N — 1, 
is given by 


N - 1 

Forward DFT X[r] = x[k]e~ i(2nkr/M) for 0 < r < M - 1; 
k = 0 
j M—l 

Inverse DFT x[k] = — ^ X[r]^ 2nkr 1 M) for 0 < k < N — 1. 

M r = 0 


(12.15) 


(12.16) 


Equations (12.15) and (12.16) are also, respectively, known as DFT analysis 
and synthesis equations. Equation (12.15) was derived in Section 12.1. By 
substituting the expression for X[r ] from Eq. (12.15), the analysis equation, 
Eq. (12.16), can be formally proved, and vice versa. The formal proofs of the 
DFT pair are left as an exercise for the reader. In Eqs. (12.15) and (12.16), the 
length M of the DFT is typically set to be greater or equal to the length N of 
the aperiodic sequence x[k]. Unless otherwise stated, we assume M — N in the 
discussion that follows. Collectively, the DFT pair is denoted as 

DFT 

x[k ] < - > X[r], (12.17) 


Examples 12.1 and 12.2 illustrate the steps involved in calculating the DFTs of 
aperiodic sequences. 
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Fig. 12.2. (a) DT sequence x[k\, 

(b) magnitude spectrum and 

(c) phase spectrum of its DTFT 
X[r] computed in Example 12.1. 


Example 12.1 

Calculate the four-point DFT of the aperiodic sequence x[k] of length N = 4, 
which is defined as follows: 


x[k] = 



k = 0 
k = 1 
k = 2 
k = 3. 


Solution 

Using Eq. (12.15), the four-point DFT of x[k] is given by 

X[r] = t x[k]e~i (27Tkr/4) 
k = 0 

= 2 + 3 x e _j(27rr/4) - 1 x e' j(27r(2)r/4) + 1 x e -j (2lr(3)r / 4) , 

for 0 < r < 3. Substituting different values of r, we obtain 


r = 0 X[0] = 2 + 3— 1 + 1=5; 

r = 1 X[l] = 2 + 3e-j (2 ^ 4) - e - j(2lr(2)/4) + 

= 2 + 3(— j) — 1 ( — 1 ) + 1 (j ) = 3 — 2 j ; 

r = 2 X[2\ = 2 + 3e _ j (27r(2) / 4) - e -j(2jr(2)(2)/4) + e -j(2jr(3)(2)/4) 

= 2 + 3( — 1) — 1(1) + 1( — 1) = —3; 

y _ 3 X[3] = 2 + 3 e -j (2jr(3 >/ 4) - e -j(2jr(2)(3)/4) + e -j(2jr(3)(3)/4) 

= 2 + 3(j) — 1(— 1) + 1(— j) = 3 + j2. 


The magnitude and phase spectra of the DFT are plotted in Figs. 12.2(b) and 
(c), respectively. 
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Example 12.2 

Calculate the inverse DFT of 


X[r] = 


5 r 

3— j2 r 
-3 r 

3+j2 r 


0 

1 

2 

3. 


Solution 

Using Eq. (12.13), the inverse DFT of X[r ] is given by 
x[k] = X['']e j(27r * r/4) = - [5 + (3 - j2) x e j(27r * /4) 


— 3 x 


+ (3 + j2) x e j(M/ 4 )] , 


forO < k < 3. On substituting different values of k, we obtain 
x[0] = ^[5 + (3-j2)-3 + (3+j2)] = 2; 


x[l] = i[ 5 + (3 - j2)eJ (2 ^ 4) - 3 e j (27r(2)/,4) + (3 + j2)e* 2 "®/ 4 >] 

= ^[5 + (3 - j2)(j) - 3( — 1) + (3 + j2)( — j)] = 3; 
x[2] = i[5 + (3 - j2)e j(2 " (2)/4) - 3e^ (2) / 4) + (3 + j2)e j(2jr(3)(2)/4) ] 
= i[5 + (3 — j2)(— 1) - 3(1) + (3 + j2)(— 1)] = -1; 
x[3] = I [ 5 + ( 3 - j2)eJ (27r(3 ^ - 3e^ (3) / 4) + (3 + j 2 ) e j (2 ^ 3 >/ 4 >] 
= i[5 + (3 - j2)(-j) - 3(— 1) + (3 + j2)(j)] = 1. 

Examples 12.1 and 12.2 prove the following DFT pair: 

2 k — 0 [5 r = 0 

3 k — 1 DFT n 3 — j2 r = 1 

-1 k — 2 * -3 r = 2 

1 k = 3 3+j2 r = 3, 


x[k] = 


where both the DT sequence x[k] and its DFT X[r] have length N — 4. 


Example 12.3 

Calculate the N -point DFT of the aperiodic sequence x [ k ] of length N, which 
is defined as follows: 


x[k] = 


1 0 < k < Ni - 1 

0 Ni < k < N. 
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Solution 

Using Eq. (12.15), the DFT of x[k ] is given by 


iv-i 


X[r] = ^x[yt]e 


—](2nkr/N) 


k = 0 


Ni~l 

= E 1 " 

k = 0 


-](lnkr/N) 


N—l 


+ E<> 

k=Ni 


. e -j(2jr kr/N) _ 


Ni-\ 

^ e -j(2n kr/N), 
k=0 


for 0 < r < (N—l). The right-hand side of this equation represents a GP series, 
which can be simplified as follows: 


ACj — 1 

X[r] = J2 ^ (27lkr/N) 
k = 0 


Ni r = 0 

J _ t -l(2irrN\/N) 

1 _ e -j(2WJV) ^ 


N\ 


g-jtTrrdVj-l )/N) 


sin(7rrNi/N) 
sin(7r r/N) 


r = 0 


r ± 0. 


Since X[r] is a complex-valued function, its magnitude and phase components 
are given by 


r = 0 


r ± 0 


l*M| = 

<X[r] = 


|X[r]| = N i and <X[r] = 0; 
sin(nrN\/N) 
sin(jtr/N) 
rcr(N\ — 1) 

b <sin(7r r N \ / IV) — <sin(jrr/A0- 


The magnitude and phase spectra for N\ — 7 and length At = 30 are shown in 
Figs. 12.3(b) and (c). 
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12.2.1 DFT as matrix multiplication 

An alternative representation for computing the DFT is obtained by expanding 
Eq. (12.15) in terms of the time and frequency indices ( k , r). For N = M, the 
resulting equations are expressed as follows: 

X[0] = x[0] + *[1] + 42] + • • • + x[N - 1], 

X[l] = 40] + 41]e~J (27r//v) + 42 ]e"j (4 44 
+ --- + x[N- l]e-J 

X[2] = 40] + 41]e~J (47r//v) + x[2]e-j (87r/A,) 

+ --- + x[N- l] e — 1)3r / J V), 

X[N - 1] = x[0] + jc [ 1 ] e-j (2(JV - 1 >^^5 + 42 
H l-JcfJV — 

(12.18) 

In the matrix- vector format they are given by 


40] 


"i i i ••• l 


40 1 

41] 


j g— j(2 jr/AT) e -j(4 n/N) . . . e -j(2(JV-l)ir/JV) 


4H 

42] 

= 

j e -j (4jr/AT) g— j(8jr / N) . . . e -j(4(JV-l)ir/JV) 


42] 

X[N - 1]_ 


j g-j(2(JV— 1)3T/JV) g— j(4(iV— l);r/A0 . . . g — j(2C2V— 1J(JV— l)jr/2V) 


_x[N - 1]_ 

DFT vector X 


DFT matrix F 

signal vector X 


( 12 . 19 ) 


Equation (12.19) shows that the DFT coefficients X[r] can be computed by left- 
multiplying the DT sequence x [£], arranged in a column vector x in ascending 
order with respect to the time index k, by the DFT matrix F . 

Similarly, the expression for the inverse DFT given in Eq. (12.16) can be 
expressed as follows: 


40] 


'1 

1 1 

1 


40] 

41] 


1 

e j(2w/JV) e j(47r/AT) 

gj(2(N— l)jr/A0 


41] 

42] 

1 

“ N 

1 

gj(43r/JV) gj(8:r / N) 

e j(4(/V-l)7r/JV) 


X[2] 

_x[N - 1]. 


. 1 

e j(2(W-l)7r/A0 gj(4(V-l)7r/JV) . . 

e j(2(V-l)(JV-l)^/V) 


_X[N - 1]_ 

signal vector 

X 


DFT matrix g=f- 


DFT vector x 


(12.20) 


which implies that the DT sequence x [k | can be obtained by left-multiplying 
the DFT coefficients X[r], arranged in a column vector X in ascending order 


536 


Part III Discrete-time signals and systems 


with respect to the DFT coefficient index r, by the inverse DFT matrix G. It is 
straightforward to show that G x F — F x G = In, where / v is the identity 
matrix of order N. 

Example 12.4 repeats Example 12.1 using the matrix-vector representation 
for the DFT. 


Example 12.4 

Calculate the four-point DFT of the aperiodic signal x[k ] considered in 
Example 12.1. 


Solution 

Arranging the values of the DT sequence in the signal vector x, we obtain 

x = [2 3 -1 1] T , 

where superscript T represents the transpose operation for a vector. Using 
Eq. (12.19), we obtain 


xtor 


'1 

1 

1 

1 


- x[0]- 

X[l] 


1 

e -j(27T/AT) 

e — j (4 jt / N) 

e -j(6tr/V) 


X[l] 

X[2] 


1 

e -j(4tr/A0 

e -j(8t r/N) 

e -j(12 n/N) 


x[2] 

X[3]_ 


_1 

g — j(6tr / N) 

e -j(12 n/N) 

e -j(18 n/N) 


,x[3]_ 


DFT matrix: F 


"1 

1 

1 

1 


' 2 " 


" 5 " 

1 

e ~j(27T/4) 

e — j(4xr 4) 

e — j(6jr/4) 


3 


3-j2 

1 

e -j(4w/4) 

e -j(8tr/4) 

g— j(12tr/4) 


-1 

— 

-3 

_1 

e -j(6jr/4) 

e -j(12jr/4) 

e — j( 1 8tt / 4) 


1 


_3+j2_ 


DFT matrix: F 

The above values for the DFT coefficients are the same as the ones obtained in 
Example 12.1. 


Example 12.5 

Calculate the inverse DFT of X[r] considered in Example 12.2. 


Solution 

Arranging the values of the DFT coefficients in the DFT vector X, we obtain 


X = [5 3 — j2 -3 3+j2] T . 


537 


12 Discrete Fourier transform 


Using Eq. (12.20), the DFT vector X is given by 


40 ] 



1 

1 

1 

41 ] 


1 

1 

e j(2*YiV) 

e j(4jr/V) 

42 ] 


“ 4 

1 

e j(4jr/iV) 

e j(8jr/iV) 

. 43 ] 



_1 

e j(6jr /N) 

e j(12 7T/JV) 


4 

1 


1 

1 

1 

1 

e j(2ir/4) 

gj(4jr/4) 

e j(67r/4) 

~4 

1 

e j(4ir/4) 

e j(87r/4) 

e j( 12 jt /4) 


_1 

e j(67r/4) 

e j(12jr/4) 

e j(18w/4) 

The above values for the DT 

sequence x 


in Example 12.2. 


1 


ALUj 

e j(67T/A0 


X[l] 

e j(12jr/iV) 


X[2] 

e j(187T/iV) 


X[3] 


' 5 ' 


" 8 " 


" 2 " 

3 — j2 

1 

12 


3 

— 3 

_ 4 

-4 


-1 

_3+j2_ 


_ 4 _ 


1 


are the same as the ones obtained 


12.2.2 DFT basis functions 


The matrix- vector representation of the DFT derived in Section 12.2.1 can 
be used to determine the set of basis functions for the DFT representation. 
Expressing Eq. (12.20) in the following format: 


" x[0] - 


"1" 


1 

41] 


1 


e j(2ir /N) 

42] 

= — X[0] 
N 

1 

+ ^ [1] 

e j(4 n/N) 

_x[N - 1]_ 


.1. 


e j(2(V-l )jt/JV) 


— X[2] 
N 


1 

e j(4jr/AT) 

e j(8*YJV) 


+ ...Lx[N- 1] 
N 


1 

e i(2(JV— lWAO 
e j(4(JV-lW/V) 


e j(4(JV-l)jr/A0 


e j(2(V— 1)(V— l)7r/lV) 


( 12 . 21 ) 


it is clear that the basis functions for the IV -point DFT are given by the following 
set of N vectors: 





■ • • exp 


/ )2(N - l)nr 

V N 


-i T 


for 0 < r < (N—l). Equation (12.21) illustrates that the DFT represents a DT 
sequence as a linear combination of complex exponentials, which are weighted 
by the corresponding DFT coefficients. Such a representation is useful for the 
analysis of LTID systems. 

As an example, Fig. 12.4 plots the real and imaginary components of the basis 
vectors for the eight-point DFT of length N = 8. From Fig. 12.4(a), we observe 
that the real components of the basis vectors correspond to a cosine function 
sampled at different sampling rates. Similarly, the imaginary components of 
the basis vectors correspond to a sine function sampled at different sampling 
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(a) (b) 


Fig. 12.4. Basis vectors for an 
eight-point DFT. (a) Real 
components; (b) imaginary 
components. 


rates. This should not be surprising, since Euler’s identity expands a complex 
exponential as a complex sum of cosine and sine terms. 

We now proceed with the estimation of the spectral content of both DT and 
CT signals using the DFT. 


12.3 Spectrum analysis using the DFT 


In this section, we illustrate how the DFT can be used to estimate the spectral 
content of the CT and DT signals. Examples 12.6-12.8 deal with the CT signals, 
while Examples 12.9 and 12.10 deal with the DT sequences. 
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Example 12.6 

Using the DFT, estimate the frequency characteristics of the decaying expo- 
nential signal g(t ) = exp(— 0.5 t)u(t). Plot the magnitude and phase spectra. 

Solution 

Following the procedure outlined in Section 12.1, the three steps involved in 
computing the CTFT are listed below. 


Step 1: Impulse-train sampling Based on Table 5. 1 , the CTFT of the decay- 
ing exponential is given by 


g (t) = e~°' 5, u(t) < CTFT > G(co) = 


1 

0.5 + j to 


This CTFT pair implies that the bandwidth of g(t) is infinite. Ideally speak- 
ing, the sampling theorem can never be satisfied for the decaying exponential 
signal. However, we exploit the fact that the magnitude |G(tw)| of the CTFT 
decreases monotonically with higher frequencies and we neglect any frequency 
components at which the magnitude falls below a certain threshold Selecting 
the value of rj = 0.01 x G (a >) | max , the threshold frequency B is given by 


1 

0.5 + j2 jtB 


<0.01 X | G(<w) | max. 


Since the maximum value of the magnitude |G(a>)| is 2 at co = 0, the above 
expression reduces to 


V0.25 + (2ttB) 2 > 50, 


or B > 7.95 Hz. The Nyquist sampling rate f\ is therefore given by 


f\ > 2 x 7.95 = 15.90 samples/s. 

Selecting a sampling rate of f\ = 20 samples/s, or a sampling interval T\ — 
1 /20 = 0.05 s, the DT approximation of the decaying exponential is given by 

g\k] = g{kT\) = e~°' 5kTl u[k] = e~ om5k u[k]. 

Since there is a discontinuity in the CT signal g(t) at t = 0 with g(0~) = 0 and 
g(0 + ) = 1, the value of g[fc] at k — 0 is set to g[0] = 0.5. based on Eq. (1.1). 


Step 2: Time-limitation To truncate the length of g [k ] , we apply a rectangular 
window of length N = 201 samples. The truncated sequence is given by 

0 . 025 * o < k < 200 


gw [k] = s-° m5k (u[k] - u[k - 201]) = 


elsewhere. 


The subscript w in g w [k] denotes the truncated version of g[A:] obtained by 
multiplying by the window function w[k}. Note that the truncated sequence 
g w [k] is a fairly good approximation of g[k], as the peak magnitude of the 
truncated samples is given by 0.0066 and occurs at k = 201 . This is only 0.66% 
of the peak value of the complex exponential g[k]. 
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Step 3: DFT computation The DFT of the truncated DT sequence g w [k] 
can now be computed directly from Eq. (12.16). Matlab provides a built-in 
function f f t, which has the calling syntax of 


>> G = f ft (g) ; 


where g is the signal vector containing the values of the DT sequence g w [£] 
and G is the computed DFT. Both g and G have a length of N, implying that 
an N -point DFT is being taken. The built-in function f f t computes the DFT 
within the frequency range 0 < r < (/V— I ). Since the DFT is periodic, we can 
obtain the DFT within the frequency range — (N — l)/2 < r < (N — l)/2 by 
a circular shift of the DFT coefficients. In Matlab, this is accomplished by 
the f ft shift function. 

Having computed the DFT, we use Eq. (12.12) to estimate the CTFT of the 
original CT decaying exponential signal g(t). The Matlab code for comput- 
ing the CTFT is as follows: 


Fig. 12.5. Spectral estimation of 
decaying exponential signal 
g(t) = exp(-0.5 t)u(t) using 
the DFT in Example 12.6. 

(a) Estimated magnitude 
spectrum: (b) estimated phase 
spectrum. 


>> 

fl : 

= 20; 

% 

>> 

tl : 

= 1/fl; 

% 

>> 

N = 

201; k = 0 : N- 1 ; 

% 

>> 

g = 

exp ( -0 . 025*k) ; 

% 

>> 

gd 

) = 0.5; 


>> 

G = 

f ft (g) ; 

% 

>> 

G = 

f ftshif t (G) ; 

% 

>> 

G = 

tl*G; 

% 

>> 

dw : 

= 2*pi*fl/N; 

% 

>> 

w = 

-pi* f 1 : dw: pi*f 1-dw; 

% 

>> 

stem (w, abs (G) ) ; 

% 

>> 

stem (w, angle (G) ) ; 

% 


set sampling rate 
set sampling interval 
set length of DT sequence to 
% N = 201 

compute the DT sequence 
% initialize the first sample 
determine the 201-point DFT 
shift the DFT coefficients 
scale DFT such that 
% DFT = CTFT 

CTFT frequency resolution 
compute CTFT frequencies 
plot CTFT magnitude spectrum 
plot CTFT phase spectrum 


The resulting plots are shown in Fig. 12.5, where we have limited the frequency 
axis to the range — 57r < co <5 tc . The magnitude and phase spectra plotted 
in Fig. 12.5 are fairly good estimates of the frequency characteristics of the 
decaying exponential signal listed in Table 5.3. 


In Example 12.6, we used the CTFT G(co) to determine the appropriate sampling 
rate. In most practical situations, however, the CTFTs are not known and one 
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is forced to make an intelligent estimate of the bandwidth of the signal. If 
the frequency and time characteristics of the signal are not known, a high 
sampling rate and a large time window are arbitrarily chosen. In such cases, it 
is advised that a number of sampling rates and lengths be tried before finalizing 
the estimates. 

Example 12.7 

Using the DFT, estimate the frequency characteristics of the CT signal h(t ) = 
2 exp(jl87rf) + exp(— j87rt). 

Solution 

Following the procedure outlined in Section 12.1, the three steps involved in 
computing the CTFT are as follows. 


Step 1: Impulse-train sampling The CT signal h(t) consists of two com- 
plex exponentials with fundamental frequencies of 9 Hz and 4 Hz. The Nyquist 
sampling rate f\ is therefore given by 

/i > 2 x 9 = 18 samples/s. 

We select a sampling rate of f\ = 32 samples/s, or a sampling interval T\ = 
1 /32 s. The DT approximation of h(t) is given by 

h[k] = h(kTi) = 2e jl8rf/32 + e" jlM/32 . 

Step 2: Time-limitation The DT sequence h [k\ is a periodic signal with fun- 
damental period Kq = 32. For periodic signals, it is sufficient to select the 
length of the rectangular window equal to the fundamental period. Therefore, 
N is set to 32. 


Step 3: DFT computation The Matlab code for computing the DFT of 
the truncated DT sequence is as follows. 

>> fl =32; % set sampling rate 

>> tl = 1/fl; % set sampling interval 

>> N = 32; k = 0 : N- 1 ; % set length of DT sequence 

» h = 2 *exp (j*18*pi*k/32) + exp ( - j *8*pi*k/32 ) ; 

% compute the DT sequence 
% determine the 32-point DFT 
% shift the DFT coefficients 


» H = fft (h) ; 

>> H = fftshift(H); 
» H = tl*H; 


% scale DFT such that 
% DFT = CTFT 
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(a) 


(b) 


Fig. 12.6. Spectral estimation of 
decaying exponential signal h (f) 
= 2 exp(jI8jrf) + exp(-j8?rf) 
using the DFT in Example 12.7. 
(a) Estimated magnitude 
spectrum; (b) estimated 
phase spectrum. 


>> dw = 2*pi*fl/N; 

>> w = -pi* f 1 : dw: pi*f 1-dw; 
>> stem (w, abs (H) ) ; 

>> stem (w, angle (H) ) ; 


% CTFT frequency resolution 
% compute CTFT frequencies 
% plot CTFT magnitude spectrum 
% plot CTFT phase spectrum 


The resulting plots are shown in Fig. 12.6, and they have a frequency resolution 
of Aru = 2tc. We know that the CTFT for hit) is given by 


2 e jI87rf + e" j87r ' < CTFT ■ > 2 8(co - 18jt) + 8(co + 8tt). 


We observe that the two impulses at co = — 8tt and 187 T radians/s are accurately 
estimated in the magnitude spectrum plotted in Fig. 12.6(a). Also, the relative 
amplitude of the two impulses corresponds correctly to the area enclosed by 
these impulses in the CTFT for hit). 

The phase spectrum plotted in Fig. 12.6(b) is unreliable except for the two 
frequencies co = —87 r and I 8 tt radians/s. At all other frequencies, the magni- 
tude \H[co)\ is zero, therefore the phase < H ia>) carries no information. This 
is because the phase is computed as the inverse tangent of the ratio between 
the imaginary and real components of H(co). When \H(co)\ is close to zero, 
the argument of the inverse tangent is given by S\/S 2 , with eiand £2 approach- 
ing zero. In such cases, incorrect results are obtained for the phase. The phase 
<H[co) is therefore ignored when \H(co)\ is close to zero. 


Example 12.8 

Using the DFT, estimate the frequency characteristics of the CT signal x(t) = 
2 exp(jl9jrr). 


Solution 

The three steps involved in computing the CTFT are as follows. 


Step 1: Impulse-train sampling The CT signal x{t) constitutes a complex 
exponential with fundamental frequency 9.5 Hz. The Nyquist sampling rate f\ 
is therefore given by 


/1 > 2 x 9.5 = 19 samples/s. 
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As in Example 12.7, we select a sampling rate of f\ — 32 samples/s, or a sam- 
pling interval T\ = 1 /32 s. The DT approximation of h(t) is given by 

x[k] = x(kTi) = 2e jl9lr * /32 . 

Step 2: Time-limitation As in Example 12.7, we keep the length N of the 
rectangular window equal to 32. 


Step 3: DFT computation The Matlab code for computing the DFT of 
the truncated DT sequence is as follows: 


» fl = 32; 

» tl = 1/fl; 

» N = 32; k = 0 : N- 1 ; 

>> x = 2*exp ( j *19*pi*k/32 ) ; 
» X = f ft (x) ; 

>> X = fftshift(X); 

» X = tl*X; 

>> dw = 2*pi*fl/N; 

>> w = -pi*f 1 : dw: pi* f 1-dw; 
>> stem(w, abs (X) ) ; 


% set sampling rate 
% set sampling interval 
% set length of DT sequence 
% to N = 32 

% compute the DT sequence 
% determine the 32 -point DFT 
% shift the DFT coefficients 
% scale DFT such that 
% DFT = CTFT 

% CTFT frequency resolution 
% compute CTFT frequencies 
% plot CTFT magnitude spectrum 


The resulting magnitude spectrum is shown in Fig. 12.7(a), which has a fre- 
quency resolution of Aco — 2 tt radians/s. Comparing with the CTFT for x(t), 
which is given by 

2e J '9' Tt 25 (w — 197r), 


we observe that Fig. 12.7(a) provides us with an erroneous result. This error 
is attributed to the poor resolution Aco chosen to frequency-sample the CTFT. 
Since Aco = 2tt, the frequency component of 1 9 re present in x(t) cannot be 
displayed accurately at the selected resolution. In such cases, the strength of 
the frequency component of 197r radians/s leaks into the adjacent frequencies, 
leading to non-zero values at these frequencies. This phenomenon is referred 
to as the leakage or picket fence effect. 

Figure 12.7(b) plots the magnitude spectrum when the number N of sam- 
ples in the discretized sequence is increased to 64. Since f ft uses the same 
number M of samples to discretize the CTFT, the resolution Aco = 2jt 7] /M — 
it radians/s. The Matlab code for estimating the CTFT is as follows: 


>> fl = 32; tl = 1/fl; % set sampling rate and interval 
>> N = 64; k = 0 : N- 1 ; % set sequence length to N = 64 
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(b) 


Fig. 12.7. Spectral estimation of 
complex exponential signal 
x(t) = 2 exp(jl97rf) using the 
DFT in Example 12.8. 

(a) Estimated magnitude 
spectrum, with a 32-point DFT. 

(b) Same as part (a) except that 
a 64-point DFT is computed. 


>> 

X = 

2 *exp (j*19*pi*k/32) 

; % 

>> 

X = 

f ft (x) ; 

% 

>> 

X = 

f f tshif t (X) ; 

% 

>> 

X = 

0 . 5*tl*X; 

% 

>> 

w = 

2*pi*f 1/N; 

% 

>> 

w = 

-pi* f 1 : dw: pi*f 1-dw; 

% 

>> 

stem (w, abs (X) ) 

% 


compute the DT sequence 
determine the 64 -point DFT 
shift the DFT coefficients 
scale DFT SO DFT = CTFT 
CTFT frequency resolution 
compute CTFT frequencies 
plot CTFT magnitude spectrum 


In the above code, we have highlighted the instructions that have been changed 
from the original version. In addition to setting the length N to 64 in the above 
code, we also note that the magnitude of the CTFT X is now being scaled by 
a factor of 0.5 x 7). The additional factor of 0.5 is introduced because we are 
now computing the DFT over two consecutive periods of the periodic sequence 
x[k]. Doubling the time duration doubles the values of the DFT coefficients, 
and therefore a factor of 0.5 is introduced to compensate for the increase. 
Figure 12.7(b), obtained using a 64-point DFT, is a better estimate for the 
magnitude spectrum of x(t) than Fig. 12.7(a), obtained using a 32-point DFT. 

The DFT can also be used to estimate the DTFT of DT sequences. Examples 
12.9 and 12.10 compute the DTFT of two aperiodic sequences. 


Example 12.9 

Using the DFT, calculate the DTFT of the DT decaying exponential sequence 
x[k] = 0.6* u[k]. 


Solution 

Estimating the DTFT involves only Steps 2 and 3 outlined in Section 12.1. 


Step 2: Time-limitation Applying a rectangular window of length N = 10, 
the truncated sequence is given by 


[k] = 


0.6* 0 < k < 9 
0 elsewhere. 
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Table 12.1. Comparison between the DFT and DTFT coefficients in Example 12.9 


DTFT frequency, 


DFT index, r 

fi r = 2 nr/N 

DFT coefficients, W[r] 

DTFT coefficients, X(fi) 

-5 

—Tt 

0.6212 

0.6250 

-4 

—0.8m 

0.6334 +j0.1504 

0.6373 +j0.1513 

-3 

—0.6m 

0.6807 +j0.3277 

0.6849 +j0.3297 

-2 

—0.4m 

0.8185 + 0.5734 

0.8235 +j0.5769 

-l 

—0.2m 

1.3142 +j0.9007 

1.3222 +j0.9062 

0 

0 

2.4848 

2.5000 

l 

0.2m 

1.3142 -j0.9007 

1.3222 -j0.9062 

2 

0.4m 

0.8185 -j0.5734 

0.8235 — j0.5769 

3 

0.6m 

0.6807 -j0.3277 

0.6849 -j0.3297 

4 

0.8m 

0.6334 -j0.1504 

0.6373 — jO. 1513 


Step 3: DFT computation The Matlab code for computing the DFT is as 
follows: 


>> 

N = 

10; k = 0 : N- 1 ; 

% 

>> 

x = 

< 

O 

% 

>> 

X = 

f f t (x) ; 

% 

>> 

X = 

f f tshif t (X) ; 

% 

>> 

w = 

-pi :2*pi/N:pi-2*pi/N; 

% 


set sequence length 
% to N = 10 

compute the DT sequence 
calculate the 10-point DFT 
shift the DFT coefficients 
compute DTFT frequencies 


Table 12.1 compares the computed DFT coefficients with the corresponding 
DTFT coefficients obtained from the following DTFT pair: 


0.6 k u[k] 


DTFT 
•< >- 


1 

1 - 0.6e-i« ' 


We observe that the values of the DFT coefficients are fairly close to the DTFT 
values. 


Example 12.10 

Calculate the DTFT of the aperiodic sequence x[k\ = [2, 1,0, 1] for 0 < k < 
3. 

Solution 

Using Eq. (12.6), the DFT coefficients are given by 

X[r] = [4, 2, 0, 2] for 0 < r < 3. 

Mapping in the DTFT domain, the corresponding DTFT coefficients are given 
by 


X(f2 r ) = [4, 2, 0, 2] for l? r = [0, 0.5 jt, : r, 1.5m] radians/s. 
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(a) (b) 


Fig. 12.8. Spectral estimation of 
DT sequences using the DFT in 
Example 12.10. (a) Estimated 
magnitude spectrum; 

(b) estimated phase spectrum. 
The dashed lines show the 
continuous spectrum obtained 
from the DTFT. 


If instead the DTFT is to be plotted within the range —n < f? < n, then the 
DTFT coefficients can be rearranged as follows: 

X(f2 r ) = [4, 2, 0, 2] for Q r — [—it, — 0.5jt, 0, 0.57r] radians/s. 

The magnitude and phase spectra obtained from the DTFT coefficients are 
sketched using stem plots in Figs. 12.8(a) and (b). For comparison, we use Eq. 
(1 1.28b) to derive the DTFT for x[k]. The DTFT is given by 


3 

X{Q) = ^x[k]e~i nk =2 + e~ jfi + e" j3fi . 

k=0 


The actual magnitude and phase spectra based on the above DTFT expression 
are plotted in Figs. 12.8(a) and (b) respectively (see dashed lines). Although 
the DFT coefficients provide exact values of the DTFT at the discrete fre- 
quencies fi r = [0, 0 . 57 T , tc, 1 . 5 jr j radians/s, no information is available on 
the characteristics of the magnitude and phase spectra for the intermediate 
frequencies. This is a consequence of the low resolution used by the DFT 
to discretize the DTFT frequency ft. Section 12.3.1 introduces the concept 
of zero padding, which allows us to improve the resolution used by the 
DFT. 


12.3.1 Zero padding 


To improve the resolution of the frequency axis Q in the DFT domain, a com- 
monly used approach is to append the DT sequences with additional zero-valued 
samples. This process is called zero padding , and for an aperiodic sequence x [k] 
of length N is defined as follows: 

[ x[k] 0 < k < N — \ 
x zp [k] = _ _ 

p [0 N < k < M - 1. 

The zero-padded sequence x zp \ k \ has an increased length of M. The frequency 
resolution A Q of the zero-padded sequence is improved from 2i r/N to 2 jt/M. 
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Fig. 12.9. Spectral estimation of 
zero-padded DT sequences 
using the DFT in Example 12.11. 
(a) Estimated magnitude 
spectrum; (b) estimated phase 
spectrum. 


Example 12.11 illustrates the improvement in the DTFT achieved with the 
zero-padding approach. 

Example 12.11 

Compute the DTFT of the aperiodic sequence x[k] = [2, 1, 0, 1] for 0 < k < 3 
by padding 60 zero- valued samples at the end of the sequence. 


Solution 

The Matlab code for computing the DTFT of the zero-padded sequence is 
as follows: 


» N = 64; k = 0 : N- 1 ; 

» x = [2101 zeros (1, 60) ] ; 
» X = f ft (x) ; 

>> X = fftshift(X); 

>> w = -pi : 2 *pi/N : pi-2 *pi/N; 
>> stem(w, abs (X) ) ; 

>> stem (w, angle (X)); 


% set sequence length 
% to N = 64 

% zero-padded sequence 
% determine the 64-point DFT 
% shift the DFT coefficients 
% compute DTFT frequencies 
% plot magnitude spectrum 
% plot the phase spectrum 


The magnitude and phase spectra of the zero-padded sequence are plotted in 
Figs. 12.9(a) and (b), respectively. Compared with Fig. 12.8, we observe that 
the estimated spectra in Fig. 12.9 provide an improved resolution and better 
estimates for the frequency characteristics of the DT sequence. 


12.4 Properties of the DFT 


In this section, we present the properties of the M-point DFT. The length of 
the DT sequence is assumed to be N < M. For N < M, the DT sequence is 
zero-padded with M — N zero-valued samples. The DFT properties presented 
below are similar to the corresponding properties for the DTFT discussed in 
Chapter 1 1 . 
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12.4.1 Periodicity 

The M-point DFT of an aperiodic DT sequence with length N ( M > N) is 
periodic with period M. In other words, 

X[r ] = X[r + M], (12.22) 

for 0 < r < M — 1 . 


12.4.2 Orthogonality 


The column vectors F r of the DFT matrix F, defined in Section 12.2.2, form 
the basis vectors of the DFT. These vectors are orthogonal to each other and, 
for the M-point DFT, satisfy the following: 

M 

f J f * = J2 p p {m • wo*. Di* = 


n = 1 


l/M for p = q 
0 for p ^ q, 


where the matrix Fj is the transpose of F p and the matrix F* is the complex 
conjugate of F q . 


12.4.3 Linearity 

If xi [ k ] and xn I k \ are two DT sequences with the following M-point DFT pairs: 

DFT DFT 

xdk] < » Xi[r] and x 2 [k] < » X 2 [r], 

then the linearity property states that 

DFT 

a\X\[k] + a 2 x 2 [k\ < > a\X\[r] + a 2 X 2 [r], (12.23) 

for any arbitrary constants a i and a 2 , which may be complex-valued. 

12.4.4 Hermitian symmetry 

The M-point DFT X[r] of a real-valued aperiodic sequence v | k | is conjugate- 
symmetric about r = M/2. Mathematically, the Hermitian symmetry implies 
that 


X[r] = X*[M - r], (12.24) 

where X*[r] denotes the complex conjugate of X[r\. 

In terms of the magnitude and phase spectra of the DFT X[r], the Hermitian 
symmetry property can be expressed as follows: 

\X[M - r]\ = \X[r]\ and <X[M - r] = -<X[r], (12.25) 

implying that the magnitude spectrum is even and that the phase spectrum is 
odd. 

The validity of the Hermitian symmetry can be observed in the DFT plotted 
for various aperiodic sequences in Examples 12.2-12.11. 
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12.4.5 Time shifting 

DFT 

lfx[k] < > X[rl then 

x[k - k 0 ] < ■ - --■- ? - > e -^ k or/ M X [ r\ (12.26) 

for an M-point DFT and any arbitrary integer k () . 

12.4.6 Circular convolution 

If x\ [T ] and X 2 [k] are two DT sequences with the following M-point DFT pairs: 

DFT DFT 

x\[k] < • — > X x [r] and x 2 [k] < - > X 2 [r], 

then the circular convolution property states that 

DFT 

x x [k)®x 2 [k] < * Xi [r]X 2 [r] (12.27) 

and 

DFT 1 

XI [k]x 2 [k] < > — [Xi[r] <8> X 2 [r]l (12.28) 

M 

where ® denotes the circular convolution operation. Note that the two sequences 
must have the same length in order to compute the circular convolution. 

Example 12.12 

In Example 10.1 1, we calculated the circular convolution y[k\ of the aperiodic 
sequences x[k ] — [0, 1, 2, 3] and h[k] = [5, 5, 0, 0] defined over 0 < k < 3. 
Recalculate the result of the circular convolution using the DFT convolution 
property. 

Solution 

The four-point DFTs of the aperiodic sequences x[k] and h[k\ are given by 
X[r] = [ 6, -2+j2, -2, -2-j2] 

and 

H[r] — [10, 5 — j5, 0, 5 +j5] 

for 0 < r < 3. Using Eq. (12.27), the four-point DFT of the circular convolu- 
tion between x[k\ and h[k] is given by 

DFT 

Xl {k] ®x 2 [k] < > [60, j20, 0 — j20] . 

Taking the inverse DFT, we obtain 

xdk] ®x 2 [k] = [15, 5, 15, 25], 
which is identical to the answer obtained in Example 10.11. 
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12.4.7 Parseval's theorem 

DFT 

If x[k] < > X[r], then the energy of the aperiodic sequence x[k] of length 

N can be expressed in terms of its M-point DFT as follows: 

N-l j M— 1 

E x = \x[k]\ 2 = — \X[r ]| 2 . (12.29) 

*=0 M k= 0 

Parseval’s theorem shows that the DFT preserves the energy of the signal within 
a scale factor of M. 


12.5 Convolution using the DFT 


In Section 10.6.1, we showed that the linear convolution xi[T] * x 2 [k] between 
two time-limited DT sequences x\[k ] and xo[k\ of lengths K\ and Kn, respec- 
tively, can be expressed in terms of the circular convolution x\[k ] ®x 2 [k\. The 
procedure requires zero padding both xi [A:] and X2[k\ to have individual lengths 
of K > ( K | + Ko — 1). It was shown that the result of the circular convolution 
of the zero-padded sequences is the same as that of the linear convolution. 

Since computationally efficient algorithms are available for computing the 
DFT of a finite-duration sequence, the circular convolution property can be 
exploited to implement the linear convolution of the two sequences xi[*] and 
X2[k] using the following procedure. 

(1) Compute the K -point DFTs X \ [r | and X 2 [r ) of the two time-limited 
sequences x\\ k] and x 2 [k]. The value of K is lower bounded by ( K j + K 2 
- 1), i.e. K >(Ki+ K 2 — 1). 

(2) Compute the product X 2 [r] = X\[r]X 2 [r] for 0 < r < K — 1. 

(3) Compute the sequence X 3 \k] as the inverse DFT of X 2 [r ]. The resulting 
sequence x 2 [k] is the result of the linear convolution between x\[k\ and 
xi[k]- 

The above approach is explained in Example 12.13. 


Example 12.13 

Example 10.13 computed the linear convolution of the following DT sequences: 


x[k] = 


' 2 

-1 

0 


k = 0 

\k\ = 1 and 
otherwise 


h[k] = 


2 k = 0 

3 |*| = 1 

-1 |*|=2 

0 otherwise, 


using the circular convolution method outlined in Algorithm 10.4 in 
Section 10.6.1. Repeat Example 10.13 using the DFT-based approach described 
above. 
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Table 12.2. Values of X'[r),H '[r] and Y[r] for 0 < r <6 in Example 12.13 


r 

X'[r] 

H'[r] 

Y[r] 

0 

0 

6 

0 

1 

0.470 -j0.589 

-1.377 — j6.031 

-4.199 — j2.024 

2 

-0.544 -j2. 384 

-2.223 +j 1.070 

3.760 + j4. 178 

3 

-3.425 -j 1.650 

-2.901 — j3.638 

3.933 +jl7.247 

4 

-3.425 +j 1.650 

-2.901 +j3.638 

3.933 — j 17.247 

5 

-0.544 +j2.384 

-2.223 — j 1 .070 

3.760 -j4.178 

6 

0.470 + j0.589 

-1.377 +j6.031 

-4.199 +j2.024 


Solution 

Step 1 Since the sequences x[k] and h[k] have lengths K x = 5 and K y = 3, 
the value of K > (5 + 3 — 1) = 7. We set K = 1 in this example: 

padding (K — K x ) — A additional zeros to x[k], we obtain 
x'[k] = [-1,2, -1,0,0, 0, 0]; 
padding (K — K/,) = 2 additional zeros to h[k], we obtain 
h'[k] = [-1,3,2, 3, -1,0, 0], 

The DFTs of x'[k] are shown in the second column of Table 12.2, where the 
values for X'[r ] have been rounded off to three decimal places. Similarly, the 
DFTs of h'[k] are shown in the third column of Table 12.2. 


Step 2 The value of Y[r] — X'\r]H'[r], for 0 < r < 6, are shown in the fourth 
column of Table 12.2. 


Step 3 Taking the inverse DFT of Y[r] yields 

y[k] = [ 0.998 -5 5.001 -1.999 5 -5.002 1.001], 

Except for approximation errors caused by the numerical precision of the com- 
puter, the above results are the same as those obtained from the direct compu- 
tation of the linear convolution included in Example 10.13. 


12.5.1 Computational complexity 

We now compare the computational complexity of the time-domain and DFT- 
based implementations of the linear convolution between the time-limited 
sequences x\ [A:] and X 2 \k] with lengths K \ and Ki, respectively. For simplicity, 
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we assume that x\[k ] and X 2 [£] are real-valued sequences with lengths K\ and 
K 2 , respectively. 

Time-domain approach This is based on the direct computation of the con- 
volution sum 

OO 

y[k] = x\[k ] * x\[k ] = x\[m\x 2 [k — m], 

m——oo 

which requires roughly K \ x K 2 multiplications and K\ x K 2 additions. The 
total number of floating point operations (flops) required with the time-domain 
approach is therefore given by 2K\ K 2 . 

DFT-based approach Step 1 of the DFT-based approach computes two K — 
(K 1 + K 2 — l)-point DFTs of the DT sequences x\[k] and X 2 [k\. In Section 
12.6, we show that the total number of flops required to implement a AT -point 
DFT using fast Fourier transform (FFT) techniques is approximately 5 K log 2 K . 
Therefore, Step 1 of the DFT-based approach requires a total of I OK log 2 K 
flops. 

Step 2 multiplies DFTs for xi[&] and X 2 [k]. Each DFT has a length of 
K = K\ + K 2 — 1 points; therefore, a total of K complex multiplications and 
K — 1 K complex additions are required. The total number of computations 
required in Step 2 is therefore given by 8 K or 8( K \ + K 2 - 1) flops. 

Step 3 computes one inverse DFT based on the FFT implementation requiring 
5 K log 2 K flops. 

The total number of flops required with the DFT-based approach is therefore 
given by 

15 K log 2 K + 6 K 15A" log 2 K flops, 

where K = K\ + K 2 — 1. Assuming K \ = K 2 , the DFT-based approach pro- 
vides a computational saving of 0((log 2 K)/K) in comparison with the direct 
computation of the convolution sum in the time domain. Table 12.3 compares 
the computational complexity of the two approaches for a few selected values 
of K\ and /f 2 . The length K of the DFT should be equal to or greater than 
(K[ + K 2 — 1) depending on its value. Where (K\ + K 2 — 1 ) is not a power of 
2, we have rounded (K 1 + K 2 — 1) to the next higher integer that is apowerof 2. 
In the second row, for example, A" 1 = 32 and K 2 = 5, which implies that ( K \ + 
K 2 — 1) = 36. Since the radix-2 FFT algorithm, described in Section 12.6, can 
only be implemented for sequences with lengths that are powers of 2, K is set to 
64. Based on the DFT-based approach, the number of flops required to compute 
the convolution of the two sequences is given by (15 x 64 x log 2 (64)) = 5760. 
In Table 12.3, we observe that for sequences with lengths greater than 1000 sam- 
ples, the DFT-based approach provides significant savings over the direct com- 
putation of the circular convolution in the time domain. If x\[k ] and x 2 [k] are 
real-valued sequences, significant further savings (about 50%) can be achieved 
using the procedures mentioned in Problems 12.18 and 12.19. 
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Table 12.3. Comparison of the computational complexities of the 
time-domain versus the DFT-based approaches used to compute 
the linear convolution 


Length Ki 
of X[ [k] 

Length A3 
of x 2 [k] 

Computational complexity, flops 

Time domain 
(2 Ki x K 2 flops) 

DFT 

(l5Klog 2 K flops) 

32 

5 

320 

5760 

32 

32 

2048 

5760 

1000 

200 

400000 

337 920 

1000 

1000 

2 000000 

337 920 

2000 

2000 

8 000000 

737 280 


12.6 Fast Fourier transform 


There are several well known techniques including the radix-2, radix-4, split 
radix, Winograd, and prime factor algorithms that are used for computing the 
DFT. These algorithms are referred to as the fast Fourier transform (FFT) algo- 
rithms. In this section, we explain the radix-2 decimation-in-time FFT algo- 
rithm. 

To provide a general frame of reference, let us consider the computational 
complexity of the direct implementation of the K -point DFT for a time-limited 
complex- valued sequence x[k ] with length K . Based on its definition, 

K - 1 

X[r] = J2 x W e ~ K2nkr/K) ’ (12.30) 

k = 0 

K complex multiplications and K — 1 complex additions are required to com- 
pute a single DFT coefficient. Computation of all K DFT coefficients requires 
approximately K 2 complex additions and K 2 complex multiplications, where 
we have assumed K to be large such that K — 1 « K. 

In terms of flops, each complex multiplication requires four scalar multi- 
plications and two scalar additions, and each complex addition requires two 
scalar additions. Computation of a single DFT coefficient, therefore, requires 
8 .Oops. The total number of scalar operations for computing the complete 
DFT is given by 8 K 2 flops. 

We now proceed with the radix-2 FFT decimation-in-time algorithm. The 
radix-2 algorithm is based on the following principle. 

Proposition 12.1 For even values of K, the K-point DFT of a complex-valued 
sequence x[k] with length K can be computed from the DFT coefficients of two 
subsequences: (i) x[2k], containing the even-numbered samples of x[k], and 
(ii) x[2k + 1], containing the odd-numbered samples of x[k]. 
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Proof 

Expressing Eq. (12.30) in terms of even- and odd-numbered samples of x[k], 
we obtain 


X[r] = E x[k]t~' iankr,K) 

£=0,2,4,... 

v ' 

Term I 


x[k]e~ i(27Ckr/K) , 

£=1,3,5,... 

' V** " 

Term II 


(12.31) 


for0< r < ( M — 1). Substituting A: = 2m in Term I and k = 2m + 1 in Term II, 
Eq. (12.31) can be expressed as follows: 

K/ 2-1 K/ 2-1 


X[r] = -4 2 m\e-i (2n(2m)r/K) + 


x[2 m + l]e- j(27rf2m+l)r/ ^) 


771=0, 1,2,... 


777=0, 1,2,... 


or 


X[r] = 


K/ 2-1 

E 


x[2m]e- i2jcmr/(K/2) 


777=0, 1,2,... 


K/ 2-1 

+ g-jtarr/*) ^ x[2m + l]e-j 27rmr / ( ^ 1 2) , (12.32) 

777=0, 1,2,... 

where exp[— j2jt(2m)r/K] = exp[— ]2nmr/(K /2)]. By expressing g[m] = 
x[2m] and h\m] = x[2m + 1], we can rewrite Eq. (12.32) in terms of the DFTs 
of g[m] and h [m ] : 


K/ 2-1 K/ 2-1 

X[r] = g[m]z~ flnmrKK,2) + e~ p - nr/K ^ h[m]s~> 27lmr/(K/2) 

m= 0,1,2,... m=0, 1,2,... 


=G[r ] 


=H[r] 


(12.33) 


or 


X[r] = G[r] + W r K H[r], (12.34) 

where Wk is defined as exp(—j27r/7f ). In FFT literature, W' K is generally 
referred to as the twiddle factor. Note that in Eqs. (12.33) and (12.34), G[r ] 
represents the (K/2)-point DFT of g[k], the even-numbered samples of x[k]. 
Similarly, H[r] represents the ( K /2)-point DFT of h[k], the odd-numbered 
samples of x[k]. Equation (12.34) thus proves Proposition 12.1. 

Based on Eqs. (12.34), the procedure for determining the K -point DFT can be 
summarized by the following steps. 

(1) Determine the ( K /2)-point DFT G [r ] for 0 < r < (K/2 — 1) of the even- 

numbered samples of x [k \ . 
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Fig. 12.10. Flow graph of a 
/C-point DFT using two 
(K /2)-point DFTs for K = 8. 



(2) Determine the (A'/2)-point DFT H[r] for 0 < r < (K/ 2 — 1 ) of the odd- 
numbered samples of x [fc] . 

(3) The -point DFT coefficients X[r] for 0 < r < (K — 1) of x[£] are 
obtained by combining the K/2 DFT coefficients G\r ] and H[r ] using 
Eq. (12.34a). Although the index r varies from zero to K — 1, we only 
compute G[r ] and H[r] over the range 0 < r < (/t/2- I). Any outside 
value can be determined by exploiting the periodicity properties of G[r] 
and H[r], which state that 

G[r] = G[r + K/ 2] and H[r] = H[r + K/2]. 


Figure 12. 10 illustrates the flow graph for the above procedure for K — 8-point 
DFT. In comparison with the direct computation of DFT using Eq. (12.30), 
Fig. 12.10 computes two (K / 2)-point DFTs along with K complex addi- 
tions and K complex multiplications. Consequently, ( K /2) 2 + K complex 
additions and (K/2) 2 + K complex multiplications are required with the 
revised approach. For K > 2, it is easy to verify that (K/2) 2 + K < K 2 ; 
therefore, the revised approach provides considerable savings over the direct 
approach. 

Assuming that K is a power of 2, Proposition 12.1 can be applied on 
Eq. (12.34) to compute the ( K /2)-point DFTs G[r] and H[r] as follows: 

K/ 4-1 K/ 4-1 

G[r] = g[2€]e” j(2 * &/( * /4)) + W’ K/2 Y ^ ll + l]e- j(27r<r/(Jf/4)) 

€= 0 , 1 , 2 ,... €= 0 , 1 , 2 ,... 


(12.35) 


and 


K/ 4-1 K/ 4-1 

H[r]= Y h[2l]e"i aKlr/(K/4)) + W' K/2 Y h ^ 21 + l]e^ (2jrfr ' W4)) . 
£= 0 , 1 , 2 ,... £= 0 , 1 , 2 ,... 


H'lr] 


H"[r ] 


(12.36) 
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Fig. 12.11. Flow graphs of 
(/C/2)-point DFTs using 
(/C/4)-point DFTs. (a) G[r\, 
(b) H[r ]. 






Fig. 12.12. Flow graphs of 
2-point DFTs required for 
Fig. 12.11. (a) Top 2-point DFT 
C'[0] and G'[l] for Fig. 12.11(a). 

(b) Bottom 2-point DFT G"[0] 
and C"[l] for Fig 12.11(a). 

(c) Top 2-point DFT W'[0] and 
H'[ 1] for Fig 12.11(b). 

(d) Bottom 2-point DFT H"[ 0] 
and H"[ 1] for Fig. 12.11(b). 



i/[0] 

m 1 ] 

H[ 2 ] 
H[ 3 ] 


Equation (12.35) expresses the ( K /2)-point DFT G[r] in terms of two ( K /4)- 
point DFTs of the even- and odd-numbered samples of g[k\. Figure 12.11(a) 
illustrates the flow graph for obtaining G[r] using Eq. (12.35). Similarly, Eq. 

(12.36) expresses the (K /2)-point DFT II [r] in terms of two ( K /4)-point DFTs 
of the even- and odd-numbered samples of h[k], which can be implemented 
using the flow graph shown in Fig. 12.11(b). If K is a power of 2, then the 
above process can be continued until we are left with a 2-point DFT. For the 
aforementioned example with K — 8, the ( K /4)-point DFTs in Fig. 12.1 1 can 
be implemented directly using 2-point DFTs. Using the definition of the DFT, 
the top left 2-point DFTs G'[0] and G'[l], for example, in Fig. 12.11(a) are 
expressed as follows: 

G'[0] = x[0] e-j 23r€r/2 | fc0r=0 + x[4] e~ fl,tlrl X =l r=0 = x[0] + x[4] 

(12.37) 

and 

G'[l] = x[0] z-' flntrl X =Q r=l + x[4] ^ lnlrl \ =X r=x = x[0] -x[4]. 

(12.38) 

The flow graphs for Eqs. (12.37) and (12.38) are shown in Fig. 12.12(a). By 
following this procedure, the flow diagrams for the remaining 2-point DFTs 
required in Fig. 12.1 1 are derived and are shown in Figs. 12.12(b)-(d). Because 
of their shape, the elementary flow graphs shown in Fig. 12.12 are generally 
referred to as the butterfly structures. 

Combining the individual flow graphs shown in Figs. 12.10, 12. 11, and 12.12, 
it is straightforward to derive the overall flow graph for the 8-point DFT, which 
is shown inFig. 12.13;inthisflow diagram, we have further reduced the number 
of operations for an 8-point DFT by noting that 

W' K/2 = e-j 2lr ''/(^/2) = e -j 4*r/K = W 2r . 

and by placing the common terms between the twiddle multipliers of the two 
branches, which are originating from the same node, before the source node. 


12.6.1 Computational complexity 

To derive the computational complexity of the decimation-in-time algorithm, 
we generalize the results obtained in Fig. 12.13, where K is set to 8. We 
observe that Fig. 12.13 consists of log 2 K — 3 stages and that each stage 
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Fig. 12.13. Decimation-in-time 
implementation of an 8-point 
DFT. 




w rrm 

A[UJ • W — '*• 


m a |_uj 

w ^ \ w / m Yin 

W* K 

';>< >< 

w - \ / rn Fpi 



^ \/\/\/ fri 

" K K 

wf w* 


N4J * * 


< / yy 

W° K W' K 


V/Vfr 

^ m/ X \ Y\(Y\ 

r r7i • - 

r 

w k / \trf 

41 >: «r 

stage 1 

w 1 ' V 

stage 2 

K~ 

stage 3 


requires K = 8 complex multiplications and K = 8 complex additions. For 
example, stage 3 in Fig. 12.13 requires multiplications with twiddle factors 
. W X K , W j, , , and four VV'^.s. This is also obvious from Eq. (12.34), 

where in order to calculate the /f-point DFT from two (K/2)-point DFTs, 
we need to perform K complex multiplications (with the twiddle factors) 
and approximately K complex additions. Therefore, the decimation-in-time 
FFT implementation for a Appoint DFT requires a total of K log 2 K complex 
multiplications and K log 2 K complex additions. 

Further reduction in the complexity of the decimation-in-time FFT imple- 
mentation is obtained by observing that 

W* /2 = e” j7r = -1. (12.39) 

Note that multiplication by a factor of — 1 can be performed by simply revers- 
ing the sign bit. It is observed from Fig. 12.13 that each stage contains four 
such multiplications (by a factor of W%). In general, for a A'-point FFT, K/2 
such multiplications exist in each stage. Ignoring these trivial multiplications, 
the total number of complex multiplications for all K stages can be reduced to 
0.5 K log 2 K complex multiplications. However, the number of complex addi- 
tions stays the same at K log 2 K. In other words, the complexity of a A'-point 
FFT can be expressed as 0.5 K log 2 K butterfly operations where a butterfly 
operation includes one complex multiplication and two complex additions. 
Note that each complex multiplication requires a total of six flops (for four 
scalar multiplications and two scalar additions), and that each complex addi- 
tion requires two flops (for two scalar additions). As each butterfly operation 
requires a total of ten flops, the overall complexity of the decimation-in-time 
FFT implementation is 5 A' log, K flops. 

Table 12.4 compares the number of computations for the direct implemen- 
tation of Eq. (12.30) and the FFT implementation. As explained above, the 
number of scalar operations for the direct implementation is assumed to be 8 A -2 
flops, whereas the number of scalar operations for the FFT implementation is 
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Table 12.4. Complexity of DFT calculation (in flops) with FFT 
and direct implementations 


K 

Number of flops 

Increase in 
Speed 

FFT (5 K log 2 K ) 

direct (8AT 2 ) 

32 

800 

8192 

10.2 

256 

10 240 

524288 

51.2 

1024 

51200 

8 388 608 

163.8 

8192 

532480 

536870912 

1 008.2 


Table 12.5. Data reordering in radix-2 decimation-in-time FFT 
implementation 


Bit-reversed representation 

Original order, x[k] Binary representation binary decimal 


x[b 2 b t b 0 \ 

x[b 0 bib 2 ] 

x re [k] 

40] 

x [000] 

x [000] 

40] 

-41] 

4001 ] 

4100] 

-44] 

-42] 

4010 ] 

4010] 

-42] 

43] 

401 1] 

4110] 

46] 

44] 

4100 ] 

x [00 1 ] 

x[l] 

45] 

4101] 

x[101] 

-45] 

46] 

4H0] 

x[01 1] 

-43] 

47] 

4111 ] 

x[lll] 

-47] 


assumed to be 5 K log 2 K flops. For large values of K, say 8192, Table 12.4 
illustrates a speed-up by up to a factor of 1000 with the FFT implementation. For 
real-valued sequences, the number of flops can be further reduced by exploit- 
ing the symmetry properties of the DFT. Further reduction in the complexity 
of the decimation-in-time FFT implementation can be obtained by ignoring 
multiplications by the twiddle factor as = 1. 

12.6.2 Reordering of the input sequence 

In Fig. 12.13, we observe that the input sequence x[k] with length K has been 
arranged in an order that is considerably different from the natural order of 
occurrence. This arrangement is referred to as the bit-reversed order and is 
obtained by expressing the index k in terms of log 2 K bits and then reversing 
the order of bits such that the most significant bit becomes the least significant 
bit, and vice versa. For K = 8, the reordering of the input sequence is illustrated 
in Table 12.5. 

The function myf ft, available in the accompanying CD, implements the 
radix-2 decimation-in-time FFT algorithm. Direct computation of the DFT 
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coefficients using Eq. (12.16) is also implemented and provided as a second 
function, mydf t . The reader should confirm that the two functions compute 
the same result, with the exception that the implementation of myf f t is com- 
putationally efficient 

As mentioned earlier, Matlab also provides a built-in function f f t to 
compute the DFT of a sequence. Depending on the length of the sequence, the 
f f t function chooses the most efficient algorithm to compute the DFT. For 
example, when the length of the sequence is a power of 2, it uses the radix-2 
algorithm. On the other hand, if the length is such that a font method is not 
possible, it uses the direct method based on Eq. (12.15). 


12.7 Summary 


This chapter introduces the discrete Fourier transform (DFT) for time-limited 
sequences as an extension of the DTFT where the DTFT frequency 12 is dis- 
cretized to a finite set of values Q — 2rcr/M, for 0 < r < (M — 1). The Ap- 
point DFT pair for a causal, aperiodic sequence x[k ] of length N is defined as 
follows: 

iV-l 

DFT analysis equation X[r ] = ^ x[k]t~ i( ' 2lzkrlM) for 0 < r < M — 1; 

k = o 

j M - 1 

DFT synthesis equation x[k] = — ’^2,X[r]^ a7lkr/M) for 0 < k < N — 1. 

M r = 0 

For M = N, Section 12.2 implements the synthesis and analysis equations of 
the DFT in the matrix- vector format as follows: 

DFT synthesis equation x = FX ; 

DFT analysis equation X = F~ l x, 

where F is defined as the DFT matrix given by 

1 1 - l 

e -j(27 t/N) e -j(4j r/N) . . . e -j(2(iV-l)jr/A0 

e — j(4jr/iV) e -j(&r//V) . . . e -j(4(V-l)jr/A0 

e _ j(2(iV— D tt/JV) e -j(4(AT-l)7T/JV) . . . e -j(2(iV-l)(iV-l)7r/iV) 



The columns (or equivalently the rows) of the DFT matrix define the basis 
functions for the DFT. 

Section 12.3 used the M-point DFT X[r] to estimate the CTFT spectrum 
X(co) of an aperiodic signal x(t ) using the following relationship: 


MT\ 


X 2 [r], 


X(co r ) 


N 
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where T\ is the sampling interval used to discretize x(t), o> r are the CTFT 
frequencies that are given by 2nr /{MT\) for —0.5 (M — 1) < r < 0.5 (M — 1), 
and N is the number of samples obtained from the CT signal. Similarly, the 
DFT X[r ] can be used to determine the DTFT X(Q) of a time-limited sequence 
x[k ] of length IV as 


N 

X(n r ) = —X[r] 

M 

at discrete frequencies <?,- = 2nr/M, for 0 < r < M — 1. 

Section 12.4 covered the following properties of the DFT. 

(1) The periodicity property states that the M-point DFT of a sequence is 
periodic with period M. 

(2) The orthogonality property states that the basis functions of the DFTs are 
orthogonal to each other. 

(3) The linearity property states that the overall DFT of a linear combination 
of DT sequences is given by the same linear combination of the individual 
DFTs. 

(4) The Hermitian symmetry property states that the DFT of a real-valued 
sequence is Hermitian. In other words, the real component of the DFT 
of a real-valued sequence is even, while the imaginary component is 
odd. 

(5) The time-shifting property states that shifting a sequence in the time domain 
towards the right-hand side by an integer constant m is equivalent to mul- 
tiplying the DFT of the original sequence by the complex exponential 
exp(— j2 Tcm/M). Similarly, shifting towards the left-hand side by an inte- 
ger m is equivalent to multiplying the DTFT of the original sequence by 
the complex exponential exp(j2 itm/M). 

(6) The time-convolution property states that the periodic convolution of two 
DT sequences is equivalent to the multiplication of the individual DFTs of 
the two sequences in the frequency domain. 

(7) Parseval’s theorem states that the energy of a DT sequence is preserved in 
the DFT domain. 

Section 12.5 used the convolution property to derive alternative procedures 
for computing the convolution sum. Depending on the sequence lengths, these 
procedures may provide considerable savings over the direct implementation 
of the convolution sum. 

Section 12.6 covers the decimation-in-time FFT implementation of the DFT. 
In deriving the FFT algorithm, we assume that the length N of the sequence 
equals the number M of samples in the DFT, i.e. N — M — K . We showed 
that if K is a power of 2, then the FFT implementations have a computational 
complexity of O (K log, K). 
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Problems 


12.1 Calculate analytically the DFT of the following sequences, with length 


o < 

k < N - 

1: 



1 

\ 1 

k = 0,3 

(i) 

x[k] = 

1 

with length N = 


1 

l« 

£=1,2 


1 

[ 

1 k even 

(ii) 

X[k] = 

1 

with length N = 8; 



l- 

1 k odd 

(iii) 

x[k] = 0.6 k 

with length N — 8; 


(iv) x[k ] = u[k] — u[k — 8] with length N = 8; 

(v) x[k ] = cos(a>ok) with coo ^ 2nm/N , m e Z . 


12.2 Calculate the DFT of the time-limited sequences specified in 
Examples 12. l(i)— (iv) using the matrix- vector approach. 


12.3 Determine the time-limited sequence, with length 0 < k < N — 1, cor- 
responding to the following DFTs X[r ], which are defined for the DFT 
index 0 < r < N — 1 : 

(i) X[r] = [1 +j4, —2 — j3, — 2+j3, 1 -j4] with N = 4; 

(ii) X[r] = [1, 0, 0, 1] with N = 4; 

(iii) X[r] — exp —](2jrkor/N), where ko is a constant; 

[ 0.5N r = ko, N — ko 

(iv) Z[r] = | where ko is a constant; 

[ 0 elsewhere 

(v) X[r] = e-J sm Or rm/N) ^ e Z and 0 < m < N\ 

sin(7rr/A^) 

(vi) X[r] — ) for 0 < r < N — 1. 


12.4 In Problem 11.1, we determined the DTFT representation for each of 
the following DT periodic sequences using the DTFS. Using Matlab, 
compute the DTFT representation based on the FFT algorithm. Plot the 
frequency characteristics and compare the computed results with the ana- 
lytical results derived in Chapter 1 1 . 

(i) x[k] — k, for 0 < A: < 5 and x[k + 6] = x[k]\ 


(ii) *[*] = 


1 Q<k<2 

0.5 3<k<5 
0 6 < k < 8 


(iii) 

(iv) 


x[k] = 3 sin 
x\k] = 2 exp 



and 


x[k + 9] =x[k]; 
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(v) x[k] = E S[k — 5m]; 

m=—o o 

(vi) x[k ] = cos(107rA:/3) cos(27rA:/5); 

(vii) x[k] = |cos(27T*/3)|. 


12.5 (a) Using the FFT algorithm in Matlab, determine the DTFT rep- 
resentation for the following sequences. Plot the magnitude and phase 
spectra in each case. 


(i) x[k ] = 2; 


(ii) x[k] = 


1*1 


1*1 <3 

otherwise; 


(iii) x[k] = k3~^\ 

(iv) x[k ] = a k cos(a>ok)u[k\, |ot| < 1; 

(v) x[k ] = a t sin(a)o^ + </>)«[*], |a| < 1; 

sin(;rA:/5) sin(7rA:/7) 

<Vi) = nV ; 

oo 

(vii) x[k ] = ^ 8[k — 5m — 3]; 


(viii) x[k] 


3-1*1 

0 


1*1 <3 
1*1 = 3 


and x[k + 7] = x[*]; 


(ix) x[k] = ej (0 - 27ri+45o) ; 

(x) x[k] = k3~ k u[k] + ei( 0 - 27r *+ 45 °). 

(b) Compare the obtained results with the analytical results derived in 
Problem 11.4(a). 


12.6 Using the FFT algorithm in Matlab, determine the CTFT represen- 
tation for each of the following CT functions. Plot the frequency char- 
acteristics and compare the results with the analytical results presented 
in Table 5.1. 

(i) x(t) = e~ 2 'u(t); 

(ii) x(t) = e -4 ^; 

(iii) x(t) = t 4 e~ 4, u(t ); 

(iv) x(t) = e~ 4 ' cos(107rt)n(f); 

(v) x(t) = e~' 2/2 . 

12.7 Prove the Hermitian property of the DFT. 

12.8 Prove the time-shifting property of the DFT. 

12.9 Prove the periodic-convolution property of the DFT. 

12.10 Prove Parseval’s theorem for the DFT. 
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12.11 Without explicitly determining the DFT X[r] of the time-limited 
sequence 

x[k] = [6 8 -5 4 16 22 7 8 9 44 2], 

compute the following functions of the DFT X[r] : 

® X[01: (iv) £>]; 

(ii) A' [10]; '=° 

10 

(iii) X ^’ (v) ^|X[r]| 2 . 

r = 0 

12.12 Without explicitly determining the the time-limited sequence x[k ] for 
the following DFT: 

X[r] = [l2, 8+j4, -5, 4+jl, 16, 16, 4— jl, -5, 8 — j4], 

compute the following functions of the DFT X[r]: 

9 

(i) x[0]; (iv) ^x[£]; 

(ii) x[9]; r =° 

(iii) x[6]; ( v ) ^ \x[k]\ 2 - 

r = 0 

12.13 Given the DFT pair 

DFT 

x[k] < ► X[r], 


for a sequence of length N, express the DFT of the following sequences 
as a function of X[r]: 

(i) y[k] = x[2*]; 


(ii) y[k] = 


x[0.5/:] k even 
0 elsewhere; 


(iii) y[k] — x[N — 1 — k] for 0 < k < N — 1; 


(iv) y[k] = 


x[k] 0 < k < N - 1 
0 N < k < 2N — 1 ; 


(v) y[k] = (x[k] -x[k- 2])ei ^ k /"\ 


12.14 Compute the linear convolution of the following pair of time-limited 
sequences using the DFT-based approach. Be careful with the time 
indices of the result of the linear convolution. 


(i) xdk] = 


0<k<3 

otherwise 


and X 2 [£] = 


2 -1 < k < 2 
0 otherwise; 


(ii) x\[k] = k for 0 < k < 3 and X 2 M = 


5 k = 0, 1 
0 otherwise; 
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(iii) xi [k] = 


(iv) xi[k] = 


2 0 < k < 2 
0 otherwise 

-1 k = -l 

1 k = 0 

2 * = 1 

0 otherwise 


and X 2 [k] = 


k+ 1 
0 


and 


X2 [&] = 



0 < k < 4 
otherwise; 

k = -1,2 
k = 0 
*=1,3 
otherwise; 


(v) xdk] = 


\k\ |*| <2 

0 otherwise 


and x 2 [*] = 


2~ k 

0 


0 < * < 3 
otherwise. 


12.15 Draw the flow graph for a 6-point DFT by subdividing into three 2- 
point DFTs that can be combined to compute X[r], Repeat for the 
subdivision of two 3-point DFTs. Which flow graph provides more com- 
putational savings? 


12.16 Draw a flow graph for a 10-point decimation-in-time FFT algorithm 
using two DFTs of size 5 in the first stage of the flow graph and five DFTs 
of size 2 in the second stage. Compare the computational complexity of 
the algorithm with the direct approach based on the definition. 

12.17 Assume that K = 3 3 . Draw the flow graph for a A" -point decimation- 
in-time FFT algorithm consisting of three stages by using radix-3 as 
the basic building block. Compare the computational complexity of the 
algorithm with the direct approach based on the definition. 


12.18 Consider two real-valued /V-point sequences x\ [*] and x 2 [k | with DFTs 
X\[r] and X 2 [r], respectively. Let p[k] be an /V-point complex-valued 
sequence such that p[k] = x\[k] + jx 2 [*] and let the DFT of p[k] be 
denoted by P[r ]. 

(a) Show that the DFTs X\[r] and A 2 [r] can be obtained from the DFT 
P[rl 

(b) Assume that N = 2"' and that the decimation-in-time FFT algorithm 
discussed in Section 12.6 is used to calculate the DFT P[r], Estimate 
the total number of flops required to calculate the DFTs Ai[r] and 
X 2 [r] using the procedure in part (a). 


12.19 Consider a real-valued N -point sequence x [*], where A is a power of 
2. Let xi [k] and xi[k] be two A/2 -point real-valued sequences such that 
xdk] =x[2k] and .r 2 [£] = x[2k + l]forO < k < A/2 - 1. Let the A- 
point DFT of x[£] be denoted by X[r] and let the A/2-point DFT of 
xi[k ] and X 2 [k] be denoted by Xi[r] and A 2 [r], respectively. 

(a) Determine X[r] in terms of X\[r ] and A 2 [r]. 

(b) Estimate the total number of flops required to calculate A[r] using 
the procedure discussed in Problem 12.18. 


CHAPTER 



The z-transform 


In Chapter 11, we introduced two frequency representations, namely the 
discrete-time Fourier series (DTFS) and the discrete-time Fourier transform 
(DTFT) for DT signals. These frequency representations are exploited to deter- 
mine the output response of an LTID system. Unfortunately, the DTFT does 
not exist for all signals (e.g., periodic signals). In situations where the DTFT 
does not exist, an alternative transform, referred to as the z-transform, may be 
used for the analysis of LTID systems. Even for DT sequences for which the 
DTFT exists, the z-transforms are always real- valued, rational functions of the 
independent variable z provided that the DT sequences are real. In comparison, 
the DTFT is generally complex-valued. Therefore, using the z-transform sim- 
plifies the algebraic manipulations and leads to flow diagram representations 
of the DT systems, a pivotal step needed to fabricate the DT system in silicon. 
Finally, the DTFT can only be applied to a stable LTID system for which the 
impulse response is absolutely summable. Since the z-transform exists for both 
stable and unstable LTID systems, the z-transform can be used to analyze a 
broader range of LTID systems. 

The difference between the DTFT and the z-transform lies in the choice of 
the independent variable used in the transformed domain. The DTFT X(<1) of a 
DT sequence x\k] uses the complex exponentials s >k ' ! as its basis function and 
maps x[k] in terms of e' ,fW . The z-transform X(z) expresses x[k] in terms of 
z , where the independent variable z is given by z = e (a+jri)t . The z-transform 
is, therefore, a generalization of the DTFT, just as the Laplace transform is a 
generalization of the CTFT. In this chapter, we introduce the z-transform and 
illustrate its applications in the analysis of LTID systems. 

This chapter is organized as follows. Section 13.1 defines the bilateral, also 
referred to as the two-sided, z-transform and illustrates the steps involved 
in its computation through a series of examples. For causal signals, the 
bilateral z-transform reduces to the one-sided, or unilateral, z-transform, which 
is covered in Section 13.2. Section 13.3 presents inverse methods of calcu- 
lating the time-domain representation of the z-transform. The properties of 
the z-transform are derived in Section 13.4. Sections 13.5-13.9 cover various 
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applications of the z-transform. Section 13.5 applies the z-transform to calculate 
the output of an LTID system from the input sequence and the impulse response 
of the LTID system. The relationship between the Laplace transform and the 
z-transform is discussed in Section 13.6. Stability analysis of the LTID system in 
the z-domain is presented in Section 13.7, while graphical techniques to derive 
the frequency response from the z-transform are discussed in Section 13.8. 
Section 13.9 compares the DTFT and z-transform in calculating the steady state 
and transient responses of an LTID system. Section 13.10 introduces important 
Matlab library functions useful in computing the z-transform and in the 
analysis of LTID systems. Finally, the chapter is concluded in Section 13.11 
with a summary of important concepts. 


13.1 Analytical development 


Section 11.1 defines the synthesis and analysis equations of the DTFT pair 
x[k ] < DTFr > X(Q) as follows: 

DTFT synthesis equation x[k~\ = — f X{(7)e) nk (13.1) 

2n J 

(2n) 

oo 

DTFT analysis equation X{Q) = Y^ x[k]eT iSik . (13.2) 

k=—oo 

To derive the expression for the bilateral z-transform, we calculate the DTFT 
of the modified version x[k]er ak of the DT signal. Based on Eq. (13.2), the 
DTFT of the modified signal is given by 

OO OO 

3{x[/k]e-' 7 *} = Y x[k]e~ ak e~ ink = Y x[k]e~ (a+m . (13.3) 

k = — oo k=—o o 

Substituting e 0+jW = z in Eq. (13.3) leads to the following definition for the 
bilateral z-transform: 

OO 

z-analysis equation X(z) = S {.a [/ r]e } = Y, x[k]z~ k . (13.4) 

k=—oo 

It may be noted that the summation in Eq. (13.4) is absolutely summable only 
for selected values of z. For other values of z, the infinite sum in Eq. (13.4) 
may not converge to a finite value, and hence X(z) becomes infinite. The region 
in the complex z-plane, where summation (13.4) is finite, is referred to as the 
region of convergence (ROC) of the z-transform X(z). 

By following a similar derivation for the DTFT synthesis equation, Eq. ( 1 3 . 1 ), 
the expression for the inverse z-transform is given by 

z-synthesis equation x[A'] = (£> X(z)z k ~ 1 dz, (13.5) 

2rrj / 

c 


567 


13 The z-transform 


where C is a closed contour traversed in the counterclockwise direction within 
the ROC. Solving Eq. (13.5) involves the application of contour integration 
techniques and is, therefore, seldom used directly. In Section 13.3, we will 
consider alternative approaches based on the look-up table, partial fraction 
expansion, and power series expansion to evaluate the inverse z-transform. 

Collectively, Eqs. (13.4) and (13.5) form the bilateral z-transform pair, which 
is denoted by 

x[k] X(z) or Z{.x[k]} = X(z). (13.6) 

To illustrate the steps involved in computing the z-transform, we consider the 
following examples. 

Example 13.1 

Calculate the bilateral z-transform of the exponential sequence x[k ] = a 1 ' u[k\. 


Solution 

Substituting x[k] = a k u[k] in Eq. (13.4), we obtain 

OO OO 

X(z) = a k u[k]z~ k = ^(az"Y 

k — — oo k = 0 


l 


1 — az 1 
undefined 


\az *| < 1 
elsewhere. 


In the above expression, if |az _1 | > 1 the bilateral z-transform has an infinite 
value. In such cases, we say that the z-transform is not defined. The set of values 
of z over which the bilateral z-transform is defined is referred to as the region of 
convergence (ROC) associated with the z-transform. In this example, the ROC 
for the z-transform pair 

a k u[k]< 7 1 


1 — az 


is given by 


ROC: \az *1 < 1 or |z| > lad 


Figure 13.1 highlights the ROC by shading the appropriate region in the complex 
z-plane. 


Fig. 13.1. (a) DT exponential 
sequence x[k] = a k u[k]~, (b) the 
ROC, |z| > |a|, associated with 
its bilateral z-transform. The ROC 
is shown as the shaded area and 
lies outside the circle of radius a. 
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Example 13.1 derives the bilateral z-transform of the exponential sequence 
x[k] = a k u[k ]: 

a k u[k ] ^ with ROC |z| > | o' | . 

1 — az 1 

Since no restriction is imposed on the magnitude of a , the bilateral 
z-transform of the exponential sequence exists for all values of a within the 
specified ROC. Recall that the DTFT of an exponential sequence exists only 
for a < 1. For a > 1, the exponential sequence is not summable and its DTFT 
does not exist. This is an important distinction between the DTFT and the bilat- 
eral z-transform. While the DTFT exists for a limited number of absolutely 
summable sequences, no such restrictions exist for the z-transform. By associ- 
ating an ROC with the bilateral z-transform, we can evaluate the z-transform 
for a much larger set of sequences. 

Example 13.2 

Calculate the bilateral z-transform of the left-hand-sided exponential sequence 
x[k] = - a k u[-k - 1], 


Solution 

For the DT sequence x[k] = —a k u[—k — 1], Eq. (13.4) reduces to 


CO —1 

X(z ) = ^2 -«*■«[-£ - lk -A = - y, (az^ 1 )*. 

k=—oo k= — oo 


To make the limits of summation positive, we substitute m = —k in the above 
equation to obtain 


OO 

*a) = - J2 ( - a ~ lz y n 

tn = 1 



1 — a l z 


undefined 


|a 'z| < 1 
elsewhere, 


which simplifies to 


X(z) = 


1 

1 — az -1 

undefined 


|z| < |a| 
elsewhere. 


The DT sequence x[k ] = — a k u[— k— 1] and the ROC associated with its 
z-transform are illustrated in Fig. 13.2. 


In Examples 13.1 and 13.2, we have proved the following z-transform pairs: 
a k u[k] 


Z 


1 — az 1 ’ 


with ROC |z| > |a|, 
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Fig. 13.2. (a) Non-causal 
functional = —a k u[—k - 1]; 
(b) its associated ROC, 

|z| < |cy |, shown as the shaded 
area excluding the circle, over 
which the bilateral z-transform 
exists. 


x[k] - —a k u[—k - 1 ] 


-8 -7 -6 -5 -4 -3 -2 -1 0 

• • — • • ¥ — T 1 f 

-a - 4 3 i 


1 2 

• • 


(a) 


Imfr} 



and 

, z 1 

-a k u[-k- 1]<— > with ROC|z| < |or|. 

1 — az * 1 2 

Although the algebraic expressions for the bilateral z-transforms are the same 
for the two functions, the ROCs are different. This implies that a bilateral z- 
transform is completely specified only if both the algebraic expression and 
the associated ROC are included in its specification. 


13.2 Unilateral z-transform 


In Section 13.1, we introduced the bilateral z-transform, which may be used to 
analyze both causal and non-causal LTID systems. Since most physical systems 
in signal processing are causal, a simplified version of the bilateral z-transform 
exists in such cases. The simplified bilateral z-transform for causal signals 
and systems is referred to as the unilateral z-transform, and it is obtained by 
assuming x[k ] = 0 for k < 0. The analysis equation, Eq. (13.4), simplifies as 
follows: 

CO 

unilateral z-transform X(z) = E x[k]z~ k . (13-7) 

k=0 

Unless explicitly stated, we will, in subsequent discussion, assume the 
“unilateral” z-transform when referring to the z-transform. If the bilateral 
z-transform is being discussed, we will specifically state this. To clarify further 
the differences between the unilateral and bilateral z-transforms, we summarize 
the major points. 

(1) The unilateral z-transform simplifies the analysis of causal LTID systems. 
Since most physical systems are naturally causal, we will mostly use unilat- 
eral z-transform in our computations. However, the unilateral z-transform 
cannot be used to analyze non-causal systems directly. 

(2) For causal signals and systems, the unilateral and bilateral z-transforms are 
the same. 
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(3) The synthesis equation used for calculating the inverse of the unilateral 
z-transform is the same as Eq. (13.5) used for evaluating the inverse of the 
bilateral transform. 


Example 13.3 

Calculate the unilateral z-transform for the following sequences: 


(i) unit impulse sequence, xj[A:] = <5 [A:]; 

(ii) unit step sequence, x 2 [A:] = u[k]; 

(iii) exponential sequence, x 2 [k] = a k u[k]; 

(iv) first-order, time-rising, exponential sequence, xn[k] — ka k u[k]\ 


(v) time-limited sequence, jc s [A ] = 


1 

2 

0 


k = 0, 1 
k = 2,5 
otherwise. 


Solution 

(i) By definition, 

OO 

X\(z) = ^2 <5 [^]s — * = <5[0]z° = 1, ROC: entire z-plane. 
k = o 


The z-transform pair for an impulse sequence is given by 
<5[fc] < > 1, ROC: entire z-plane. 


(ii) By definition, 

OO OO 

X 2 (z) = 

k=0 k = 0 


for |z *| < 1 

1 - z _1 

undefined elsewhere. 


The z-transform pair for a unit step sequence is given by 


u[k] 



ROC: |z| > 1. 


In the above transform pair, note that the ROC |z 1 1 < 1 is equivalent to kl > i 
and consists of the region outside a circle of unit radius in the complex z-plane. 
This circle of unit radius, with the origin of the z-plane as the center, is referred 
to as the unit circle and plays an important role in the determination of the 
stability of an LTID system. We will discuss stability issues in Section 13.7. 
(iii) By definition, 


x 3(z) = ^2 aku W z k = ( az ' )k 

k=0 k = 0 


forlaz 1 1 < 1 

1 — az 1 

undefined elsewhere. 


The z-transform pair for an exponential sequence is therefore given by 


a k u[k] 


1 — az 1 ’ 


ROC: |z| > |of | . 
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In the above transform pair, the ROC |az _1 1 < 1 is equivalent to |z| > a and 
consists of the region outside the circle of radius |z| — a in the complex z- 
plane. Example 13.1 derives the bilateral z-transform for the function JC 3 [A:] = 
a k u[k]. Since the function is causal, the bilateral and unilateral z-transforms 
are identical. 

(iv) By definition, 

OO OO 

X(z) — ^2 ka k u[k] Z ~ k — T, k(az~ x ) k ■ 
k=0 k= 0 


Using the following result: 

OO 

X>‘ = 

k=0 


r 

(1 - r) 2 ’ 


provided |r| < 1 , 


the above summation reduces to 


X(z) = 


az 


-1 


(1 — az l ) 2 ’ 


ROC: \az~ l \ < 1. 


The z-transform pair for a time-rising, complex exponential is given by 

,-1 


ka k u[k] 


az 


az 


(1 — az ') 2 (z ~ a) 2 ' 


ROC: |z| > lor I . 


(v) Since the input sequence x=,[k] is zero outside the range 0 < k < 5, 
Eq. (13.4) reduces to 

OO 

X{z)=yx[k]z- k =xm+x[\]z- l +x[2\ z - 2 +x[?>}z-*+x[A]z-*+x[5]z- 5 . 

k= 0 


Substituting the values of JCs[fc] for the range 0 < k < 5, we obtain 


Z(z) = 1 + z 1 + 2 z 2 + 2z 5 ROC: entire z-plane, except z = 0. 


For finite-duration sequences, the ROC is always the entire z-plane except for 
the possible exclusion of z = 0 and z = 00 . 


13.2.1 Relationship between the DTFT and the z-transform 

Comparing Eq. (13.2) with Eq. (13.4), the DTFT can be expressed in terms of 
the bilateral z-transform as follows: 

OO 

X(S2) = y = X(z)Uei«- (13.8) 

k——oo 

Since, for causal functions, the bilateral and unilateral z-transforms are the 
same, Eq. (13.8) is also valid for the unilateral z-transform for causal functions. 

Equation (13.8) shows that the DTFT is a special case of the z-transform 
with z = e'”. The equality z = e> fi corresponds to the circle of unit radius 
( | Z | = 1) in the complex z-plane. Equation (13.8) therefore implies that the 
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Table 13.1. Unilateral z-transform pairs for several causal DT sequences 


DT sequence 

x[k\ = - 1 - (f X(z)z k -'Az 
2n] J 
c 


z-transform with ROC 

oo 

X(z) = J2 x ^ z ~ k 

k = — oo 


(1) Unit impulse 
x[k] = 5[/t] 

(2) Delayed unit impulse 
x[k] = S[k — k 0 \ 

(3) Unit step 
x[k\ = u\k\ 

(4) Exponential 
x[k ] = a k u[k] 

(5) Delayed exponential 
x[k ] = a k ~ l u[k — 1] 

(6) Ramp 

x[k ] = ku[k] 

(7) Time-rising exponential 
x[k ] = ka k u[k] 

(8) Causal cosine 

x[k ] = cos(Do&)»[&] 

(9) Causal sine 

x[k ] — sin(J?o k)u\k\ 

(10) Exponentially modulated cosine 
x[k ] — a k cos(f2ok)u[k] 

(11) Exponentially modulated sine I 
x[k ] — a k sin(DoU)M[&] 

(12) Exponentially modulated sine II 
x[k] = ra k sin(Do£ + 8)u[k], 
with a € R. 


1, ROC: entire z-plane 
z _ *°,ROC: entire z-plane, except z = 0 
-. ROC: |z| > 1 
ROC: |z| > |or | 
ROC: |z| > |a| 
ROC: |z| > 1 


1 

1 - z _1 z - 1 ’ 
1 _ z 

1 — az _1 z — i 


„-i 


1 


1 — o;z — 1 z — a ’ 

,-t 


(1-z- 1 ) 2 (z — l) 2 ’ 

-l 


az 


az 


1 — Z 1 cos Oo 


ROC: |z| > | cr | 
z[z - cos D 0 ] 


1 — 2z _1 cos D 0 + z~ 2 z 2 — 2z cos D 0 + 1 
z _1 sinDo z sin Do 

1 — 2z~‘ cos D 0 + z~ 2 z 2 — 2 z cos D 0 + 1 
1 — az -1 cos Do z[z — a cos Do] 


1 — 2 az~ l cos D 0 + a 2 z~ 2 z 2 — 2 az cos D 0 + a 2 

az -1 sin Do az sin Do 


1 — 2az~ x cos Do + a 2 z~ 2 z 2 — 2az cos Do + a 2 


, ROC: |z| > 1 
, ROC: | z | > 1 

ROC: |z| > \a\ 
ROC: | z | > a 


A + Bz- 1 


_ z(Az + B) 

1 + 2 yz~ 1 +a 2 z~ 2 z 2 + 2 yz + y 


ROC: |z| < |o: | 


(a) 


(») Where r 


j A 2 a 2 + B 2 - 2ABy 

- , Do — cos 


a 2 — y 2 



and 8 = tan 


/ A^ a 2 - y 2 \ 

\ B-Ay J 


DTFT is obtained by computing the z-transform along the unit circle in the 
complex z-plane. 

Table 13.1 lists the z-transforms for several commonly used sequences. Com- 
paring Table 13.1 with Table 1 1 .2, we observe that when the sequence is causal 
and its DTFT exists, the DTFT can be obtained from the z-transform by sub- 
stituting z = e'T Since the substitution z = e ,!/ can only be made if the ROC 
contains the unit circle, an alternative condition for the existence of the DTFT 
is the inclusion of the unit circle within the ROC of the z-transform. If the ROC 
of a z-transform does not include the unit circle, we cannot substitute z = 
and we say that its DTFT cannot be obtained from Eq. (13.8). For example, the 
ROC of the unit step function is given by kl > 1, which does not contain the 
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unit circle. Equation (13.8) is, therefore, not valid for the unit step function. 
This may also be verified from Table 11.2, where the DTFT of the unit step 
function is different from the value obtained by substituting z — e* fi in its z- 
transform. The DTFT of the unit step function in Table 1 1.2 contains the Dirac 
delta functions, which makes the amplitude of the DTFT infinite at certain 
frequencies. No Dirac delta functions exist in the z-transform of the unit step 
function. Fikewise, the ROCs for the z-transforms of the sine and cosine waves 
do not contain the unit circle, and Eq. (13.8) is also not valid in these cases. 


13.2.2 Region of convergence 

As a side note to our discussion, we observe that the z-transform is guaranteed 
to exist at all points within the ROC. For example, consider the causal sinusoidal 
sequence x[k~\ — cos(0.27t£:)m[T], whose z-transform is given in Table 13.1 as 
follows: 


X(z) = 


1 — cos(12 0 )z 1 
1 - cos(f2 0 )z _1 + z -2 ’ 


ROC: |z| > 1, 


with fi o = 0.27T. We are interested in calculating the values of its z-transform 
at two points zi — 2 + j0.6 and Z 2 = 0.8 + j0.6. Since z,\ lies within the ROC, 
|z| > 1, the value of the z-transform at zi is given by 


X(z) = 


1 — COS(0.27r)z 1 
1 — cos(0.2:r)z _1 + z~ 2 


z=2+j0.6 


1.39 -j0-05. 


However, the point zi = 0.8 + j0.6 lies outside the ROC, |z| > 1. Therefore, 
the z-transform of the causal sinusoidal sequence cannot be computed for zi- In 
the following, we list the important properties of the ROC for the z-transform. 


(1) The ROC consists of a 2D plane of concentric circles of the form |z| > zo 
or |z| < zo- All entries in Table 13.1 have ROCs that are concentric circles. 

(2) The ROC does not include any poles of the z-transform. 


The poles of a z-transform are defined as the roots of its denominator poly- 
nomial. Since the value of the z-transform is infinite at the location of a pole, 
the ROC cannot include any pole. Property (2) can be verified for all entries in 
Table 13.1. Consider, for example, the unit step function, which has a single 
pole at z = 1 . The ROC of the z-transform of the unit step function is given by 
|z| > 1 and does not include its pole (z = 1). 


(3) The ROC of a right-hand-sided sequence ( x[k ] = 0 for k < ko) is defined 
by the region outside a circle. In other words, the ROC of a right-hand-sided 
sequence has the form |z| > zo- 

Entries (3)— (12) in Table 13.1 are right-hand- sided sequences. Consequently, it 
is observed that the ROC for all these sequences is of the form |z| > Zo- 
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(4) The ROC of a left-hand-sided sequence (x[A] = 0 for A > Ao) is defined 
by the inside region of a circle. Mathematically, this implies that the ROC 
of a left-sided sequence has the form |z| < zo- 

In Example 13.2, we computed the ROC for the left-hand-sided exponential 
sequence x[k ] = —a k u[— k — 1] as |z| < a , which satisfies Property (4). 

(5) The ROC of a double-sided (or bilateral) sequence, which extends to infinite 
values of k in both directions, is confined to a ring with a finite area and 
has the form z i < |z| < Zi- 

An example of a double-sided sequence is x[k] = /3 k u[k] — a k u[— k — 
1]. By applying the linearity property, which is formally derived in 
Section 13.4.1, it is observed that the z-transform is given by 

P k u[k] - a k u[-k - 1] + 1— r, ROC: P < \z\ < a, 

1 — az 1 1 — pz 

which satisfies Property (5). 

(6) The ROC of a finite-length sequence ( x[k ] = 0 for k < k\ ,k> ki) is the 
entire z-plane except for the possible exclusion of the points z = 0 and 
z = oo. 

As an example of Property (6), we consider entries (1) and (2) of Table 13.1. 
Also, sequence ^[A] defined in Example 13.3 is a finite-length sequence. In 
such cases, we note that the ROC consists of the entire z-plane except for the 
possible exclusion of z = 0 and z = oo. 


13.3 Inverse z-transform 


Evaluating the inverse of z-transform is an important step in the analysis of 
LTID systems. There are four commonly used methods to evaluate the inverse 
z-transform: 

(i) table look-up method; 

(ii) inversion formula method; 

(iii) partial fraction expansion method; 

(iv) power series method. 

Evaluating the inverse z-transform using the inversion formula (method (ii)) 
involves contour integration, which is fairly complex and beyond the scope of 
the text. In this section, we cover the remaining three methods in more detail. 


13.3.1 Table look-up method 

In this method, the z-transform function X(z) is matched with one of the entries 
in Table 1 3 . 1 . As the transform pairs are unique, the inverse transform is readily 
obtained from the time-domain entry. For example, if the inverse z-transform 
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of the function 

X(z) = 1 ROC: |z| > 0.3 

1 — 0.3z _1 

is required, we determine that the matching entry in Table 13.1 is given by the 
transform pair 

a k u[k]+^-+ r , ROC: |z| > a. 

1 — az 1 

Substituting a = 0.3, the inverse z-transform of X(z) is given by x[k] = 
03 k u[k]. The scope of the table look-up method is limited to the list of 
z-transforms available in Table 13.1. 


13.3.2 Inversion formula method 

In this method, the inverse z-transform is calculated directly by solving the 
complex contour integral specified in the synthesis equation, Eq. (13.5). This 
approach involves contour integration, which is beyond the scope of the text. 


13.3.3 Partial fraction method 


In LTID signals and systems analysis, the z-transform of a function x[k] gen- 
erally takes the following rational form: 


X{z) = 


N(z) 

D(z) 


b m z' n + b m -\z m 1 H h biz + b 0 

z n + a ;! _iz " _1 H h a\z + a 0 


or alternatively 


X(z) = 


N'(z) = b m + b m _ x z~ x + ■ ■ ■ + b lZ -"’ +l + b 0 z~ m 
D'{z) ~ 1 + a„-\z~ x H h + aoz~ n 


(13.9a) 


(13.9b) 


Note that the numerator N(z ) and denominator D(z) in Eq. (13.9a) are polyno- 
mials of the complex function z. In this case, the inverse z-transform of X(z) can 
be calculated using the partial fraction expansion method. The method consists 
of the following steps. 


Step 1 Calculate the roots of the characteristic equation of the rational function 
Eq. (13.9a). The characteristic equation is obtained by equating the denominator 
D(z) in Eq. (13.9a) to zero, i.e. 

D(z) = z” + a n — iz” '+•■■ + oiz + ciq = 0. (13.10) 

For an nth-order characteristic equation, there will be n first-order roots. 
Depending on the value of the coefficients {/?/}, 0 < Z < n — 1, roots { p r } , 
1 < r < n, of the characteristic equation may be real-valued and/or complex- 
valued. By expressing D(z) in the factorized form, the z-transform A'(z) is 
represented as follows: 

X(z) = ATz) 

Z z(z - Pl)(z - Pi) ■ ■ • (z - p„-l)(z - Pn)' 


(13.11) 
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It may be noted that in Eq. (13.1 1) we represent X(z)/z, not X(z), in terms of 
its poles. The reason for this will become clear after step 3. 


Step 2 Using Heaviside’s partial fraction expansion formula, explained in 
Appendix D, decompose X(z)/z into a summation of the first- or second-order 
fractions. If no roots are repeated, X(z.)/z is decomposed: 


X(z) _ k 0 k x + k 2 k n _ i k n 

Z Z Z- pi Z - P2 Z- Pn-l Z- Pn 


(13.12) 


where the coefficients {£,}, 0 < r < n , are obtained from the following expres- 
sion: 


kr 


(Z - Pr) 


N(z ) 
zD(z) 


Z=Pr 


(13.13) 


It may be noted that Eq. (13.13) appends roots {p r }, 1 < r < n, of the char- 
acteristic equation, Eq. (13.10), with an additional root po — 0 such that n + 1 
partial fraction coefficients are obtained by solving Heaviside’s expression. 

If there are repeated roots, X(z) takes a slightly different form (see Appendix 
D for more details). It is important to associate separate ROCs with each partial 
fraction term in Eq. (13.12). The ROC for each partial fraction term is deter- 
mined such that the intersection of these individual ROCs results in the overall 
ROC specified for X(z). 

Multiplying both sides of Eq. (13.12) by z, we obtain 

X(z) = ko + k\ b k2 b ■ ■ • + k„_i \- k n 

Z - pi Z - P2 Z- Pn - 1 Z - Pn 

(13.14a) 


or 


X(z) = ko + k\ 
+ k n — 


1 

1 - piz~ 

1 


+ 


P2Z 


-1 


PnZ 


-1 ' 


Pn—lZ 


-1 


(13.14b) 


Step 3 The inverse transform of X(z) can now be calculated by calculating the 
inverse transform of each individual partial fraction in Eq. (13.14a) using the 
following transform pair (see Table 13.1): 

1 7 

a k u[k]+^-> - = , ROC: |z| > a, 

1 — az 1 z — a 

and is given by 

x[k ] = k 0 (5[k] + k\{pi) k u[k] + k 2 {pi) k u[k] 4 b k n -i(p n -i) k u[k] 

+ k n ( Pn ) k u[k]. (13.14c) 

The reason for performing a partial fraction expansion of X(z)/z and not of 
AT") should now be clear. It was done so that the transform pair in Eq. (13.14b) 
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can readily be applied to calculate the inverse transform. Otherwise, we would 
be missing the factor of z in the numerator of Eq. (13.14a), and application of 
Eq. (13.14b) would have been more complicated. 

To illustrate the aforementioned procedure (steps (l)-(3)) for evaluating the 
inverse z-transform using the partial fraction expansion, we consider the 
following example. 


Example 13.4 

The z-transform of three right-sided functions is given below. Calculate the 
inverse z-transform in each case. 


(i) 30 (z) = 

(ii) X 2 (z) = 

(iii) 30s(z) = 


z 

z 2 - 3z + 2’ 

1 

(z — 0.1)(z — 0.5)(z + 0.2)’ 
2z(3z + 17) 

(z- l)(z 2 — 6z + 25)’ 


Solution 

(i) The characteristic equation of X [ (z ) is given by z 2 — 3z + 2 = 0, which has 
two roots, at z = 1 and 2. The z-transform X \ (z) can therefore be expressed as 
follows: 

30(z) _ 1 _ k\ k 2 

z z 2 — 3z + 2 z — 1 + z — 2 


Using Heaviside’s partial fraction expansion formula, the coefficients of the 
partial fractions k\ and k 2 are given by 


and 


h = 


k 2 = 


(z- 1) 


1 

(z — l)(z — 2). 


(z — 2) 


1 


(z - l)(z - 2). 



i 

Z=1 

_z - 2_ 


' 1 ' 

z—2 

_z — 1. 


= -1 


z=l 


= 1 . 


z = 2 


The partial fraction expansion of X ! (z) is therefore given by 


30 (z) = 


+ 


-1 


1 


(z — 1) (z — 2) (1-z- 1 ) (1 — 2z -1 )’ 

ROC:|z|>l ROC:|z|>2 ROC:|z|>l ROC:|z|>2 


where the ROC is obtained by noting that each term in 20 (z) corresponds 
to a right-hand- sided sequence. This follows directly from knowing that 
x[n] is right-hand-sided; hence, each term in X i (z) should also correspond 
to a right-hand sequence. Calculating the inverse z-transform of 30 (z), we 
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obtain 


xi [k] = —u[k] + 2 k u[k] = (2 k - 1 )u[k]. 

(ii) The characteristic equation of X 2 (z) has three roots, at z = 0.1, 0.5 
and —0.2. Therefore, X 2 (z.)/z can be expressed as follows: 

X 2 (z ) = 1 

z z(z — 0.1)(z — 0.5)(z + 0.2) 

ko k i k~j k 2 

= 1 1 1 — . 

z z — 0.1 z — 0.5 z + 0.2 

The partial fraction coefficients ko, k \ , k 2 , and k 2 are given by 

1 


ko 


1 = 


( 2 - 0 . 1 ) 


z(z — 0.1)(z — 0.5)(z + 0.2) 
1 


= 100 , 


z=0 


k 2 = 


{z - 0.5) 


z(z — 0.1)(z — 0.5)(z + 0.2) J z=0 ! 

1 


z(z — 0.1)(z — 0.5)(z + 0.2) 


Jz=0.5 


250 

50 

T’ 


and 


h = 


(z + 0.2)- 


1 


-I z= — 0.2 


z(z — 0.1)(z — 0.5)(z + 0.2) 

The partial fraction expansion of X 2 (z)/z is therefore given by 

X 2 (z) _ 100 250 1 50 1 500 1 

z z 
or 


500 

~ 2 \' 


3 (z — 0.1) 7 (z — 0.5) 21 (z + 0.2) 


X 2 (z) = 100 - 


250 


1 


50 


1 


500 


1 


3 (1 — 0. lz 1 ) 7 (1 — 0.5z x ) 21 (1+0.2Z- 1 )' 


Using the pairs in Table 13.1 and assuming a right-hand- sided sequence, the 
inverse z-transform is given by 


x 2 [k] = 100<5[£] 


250 


50 


500 


- — (0.1)* + y(0.5)* - —(0.2)* \ U[k], 


(iii) The characteristic equation of X 2 (z) has one real-valued root at z = 1 
and two complex-conjugate roots at z = 3 ± j4. Combining the complex roots 
in a quadratic term, X 2 (z)/z can be expressed as follows: 

X 3 (z) _ 2(3z + 17) _ k x k 2 z + A : 3 

z (z - l)(z 2 - 6z + 25) z - 1 + z 2 - 6z + 25 ’ 

Using Heaviside’s partial fraction expansion formula, coefficient k\ is given by 

2(3z + 17) 


k i = 


(z-l) 


(z — 1 )(z 2 — 6z + 25) 


= 2 . 


Jz=l 
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To determine the remaining partial fraction coefficients k 2 and k 3 , we expand 

2(3z + 17) _ 2 k 2 z + k 3 

(z - 1 )(z 2 - 6z + 25) “ z - 1 + z 2 - 6z + 25 

by cross-multiplying and equating the numerators, we obtain 

2(3z + 17) = 2(z 2 - 6z + 25) + (k 2 z + Jt 3 )(z - D- 

Comparing coefficients of z 2 and z yields 

coefficients of z 2 0 = 2 + k 2 =+ k 2 = — 2; 

coefficients of z 6 = — 12 — k 2 + k 3 =>■ £3 = 16. 


The partial fraction expansion of X 3 (z) can therefore be expressed as follows: 

X 3 (z) _ _2_ -2 z + 16 

z z — 1 z 2 — 6 z + 25 
or 


X 3 (z) = 2 — - 

z - 1 



z(z - 5 x 0.6) 
z 2 — 2x5xzx 0.6 + 5 2 
z(5 x 0.8) 

— 2 x 5 x z x 0.6 + 5 2 ’ 


where the final rearrangement makes the three terms in the above expres- 
sion consistent with entries (4), (10), and (11) of Table 13.1, with a — 5, 
and cos(i2o) = 0.6 and sin(f2o) = 0.8. Assuming that the three terms repre- 
sent right-hand-sided sequences, the inverse z-transform for each term is given 
by 


term 1 
term 2 
term 3 


' z(z - 5 x 0.6) 

_z 2 — 2 x 5 x z x 0.6 + 5 2 _ 

5 I" z(5 X 0.8) 1 z- 

2 _ z 2 — 2 x 5 x z x 0.6 + 5 2 _ 


■> 2 u[k]\ 

— > —2 • cos(cos -1 (0.6)l:) • 5 k u[k\, 
■> - • sin(cos _1 (0.6)A:) • 5 k u[k], 


Substituting cos 1 (0.6) = 0.9273, the three terms are combined as follows: 
^ 3 [it] = 2 m [ it] -2-5* cos(0.9273k)t/[k] + y 5 k sin(0.9273tt) u[k], 
which can be simplified to 


jc 3 [it] = {2 + 3.2016 x 5* cos(0.9273 it - 128.7°) }u[k]. 


The DT sequences x\[k\, x 2 [k], and x 3 [k] are plotted in Fig. 13.3 for duration 
0<k<6. 
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X] [k\={2 k -\)u[k\ x 2 [k] 



x 3 [AJ 


* • • 

- 2-1 0 


346, 


76 


219 


It 


I I I. 


5 6 


12 3 4 


>k 


(a) 


(b) 


(c) 


A I 

297 | 


-7297 , 
-49239 


Fig. 13.5. DT sequences 
obtained in Example 13.4. 

13.3.4 Power series method 

When X(z) is a rational function of the form in Eq. (13.9), the partial fraction 
expansion is a convenient method of calculating the inverse z-transform. At 
times, however, it may be difficult to expand X(z) as partial fractions, especially 
when A(z) is not a rational function. In such cases, we use the power series 
method. Alternatively, we may be interested in determining a few values of x[k] 
for k > 0. The power series method is easy to apply since it does not require 
the evaluation of the complete inverse z-transform. 

In the power series method, the transform X(z ) is expanded by long division 
as follows: 

N(z ) , , 

X(z) = — — = a + bz 1 + cz ~ +dz 3 H . (13.15a) 

D(z) 

Taking the inverse z-transform of Eq. (13.15), we obtain 

x[k] =a8[k] + b8[k- \] + c8[k -2] + d8[k - ?>] + ■■ ■ , (13.15b) 

which implies that x [0] = a, x[l] = b, x[2] = c, and x[3] = d. Additional 
samples of x[k] can be obtained by determining additional terms in the quotient 
of Eq. (13.15a). We now illustrate the application of the power series method 
with an example. 


Example 13.5 

Calculate the first four non-zero values of the following right-sided sequences 
using the power series approach: 

Z 


(i) *i(z) = 


— 3z + 2’ 


(ii) 

(hi) 


X 2 (z) = 


X 3 (z) = 


1 

(z — 0. l)(z — 0.5)(z + 0.2) ’ 
2z(3z + 17) 

Cz - l)(z 2 -6z + 25)' 
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Solution 

(i) Using long division, X | (z) can be expressed as follows: 

z" * 1 + 3z~ 2 + 7z~ 3 + 15z~ 4 


3 - 2z _1 
3 - 9 z± + 6z~ 2 
7z~' — 6 z~ 2 
7z~‘ -21z~ 2 + 14z~ 3 
15z“ 2 - 14z -3 
15z~ 2 - 45z~ 3 + 30z~ 4 . 

In other words, 

Xi(z) = n — I = 0 z° + z" 1 + 3z -2 + 7z“ 3 + 15z -4 + • • • . 

z- - 3z + 2 

Taking the inverse transform gives the following values for the first five samples 
ofxj[k]: 


xi[0] = 0,X![1] = 1, Xi[2] = 3, X! [3] = 7,xi[4] = 15. 


Note that the above values are consistent with Fig. 13.3(a) obtained in Example 
13.4 (i). 

(ii) Using long division, X 2 (z) can be expressed as follows: 


z~ 3 + 0.4z~ 4 + 0.23z“ 5 + 0. 1 lz~ 6 


1 — 0.4z 2 — 0.07z + 0.01 


1 

1 - Q.4z -1 - 0.07z~ 2 + Q.OIOz - 


0.4Z- 1 +0.07z- 2 -O.OIOz' 3 
0.4z -1 - 0.16z~ 2 - 0.028z~ 3 + 0.0040z~ 4 
0.23z“ 2 + 0.018z~ 3 - 0.0040z~ 4 
0.23z~ 2 - 0.092z~ 3 - 0.0161z~ 4 + 0.0023z~ 5 
0.1 lz -3 + 0.0121z~ 4 - 0.0023 z“ 5 
0. 1 lz“ 3 + 0.0440 z — 4 - 0.0077 z“ 5 + 0.00 1 lz“ 


In other words, 

1 

X 2 (z) = 

(z — 0.1)(z — 0.5)(z + 0.2) 

= 0z° + Oz" 1 + Oz -2 + z" 3 + 0.4z -4 + 0.23z -5 + 0. 1 lz" 6 + • ■ ■ . 

Taking the inverse transform gives the following values for the first seven sam- 
ples of x 2 [k]: 


x 2 [0] =0,x 2 [l] = 0, x 2 [2] = 0, x 2 [3] = 1 , x 2 [4] = 0.4, x 2 [5] = 0.23, x 2 [6] = 0.11. 


This result is consistent with Fig. 13.3(b) obtained in Example 13.4(h). 
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(iii) Using long division, X}(z) can be expressed as follows: 


6z _1 + 76z“ 2 + 346z“ 3 + 216z“ 4 


z 3 — 7z 2 + 31z — 25 


6z 2 + 34z 

6z 2 - 42z + 186 - 150z _1 


76z — 186 + 150z _1 

76 z - 532 + 2356z~‘ - 1900z~ 2 
346 - 2206z _1 + 1900z“ 2 
346 - 2422Z" 1 + 10726z~ 2 - 8650z~ 3 
216z“‘ - 8826z -2 + 8650z“ 3 
216z _1 - 15 12z — 2 + 6696z“ 3 - 5400z“ 3 . 


In other words, 

X 3 (z) = ^ (3 , Z+ i ?) = 0z° + 6z _1 + 76z -2 + 346z -3 + 216z~ 4 + • • • . 

(z - lXz 2 - 6z + 25) 

Taking the inverse transform gives the following values for the first five samples 
of x 3 [fc]: 

x 3 [0] = 0, x 3 [l] = 6, x 3 [2] = 76, x 3 [3] = 346, x 3 [4] = 216. 

The result is consistent with Fig. 13.3(c) obtained in Example 13.4(iii). 


13.4 Properties of the z-transform 


The unilateral and bilateral z-transforms have several interesting properties, 
which are used in the analysis of signals and systems. These properties are 
similar to the properties of the DTFT, which were covered in Section 1 1 .4. In 
this section, we discuss several of these properties, including their proofs and 
applications, through a series of examples. A complete list of the properties is 
provided in Table 13.2. In most cases, we prove the properties for the unilateral 
z-transform. The proof for the bilateral z-transform follows along similar lines 
and is not included to avoid repetition. 


13.4.1 Linearity 

If xi[A:] and xz[k \ are two DT sequences with the following z-transform pairs: 
xi[f] Al!(z), ROC: R\ 

and 

x 2 [k]<A+X 2 (z), ROC :R 2 , 

then 

fliXi[T] + fl 2 * 2 |U] > ci\X\(z) + azX 2 (z), ROC: at least Ri (T Rz- (13.16) 

The linearity property is satisfied by both unilateral and bilateral z-transforms. 
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Table 13.2. Properties of the z-transform for transform pairs x[k]<r—>X(?), ROC: R x ,x[k\u[k\^~^X l ' c \z), ROC: 
R x ;x,[k]+^X,(z), ROC: R^;x 2 [k]^X 2 (z), ROC: R 2 


Properties 

Time domain 

z-domain 

ROC 

Linearity 

Cl\Xl[k ] + d 2 X 2 [k\ 

aiXXz) + a 2 X 2 (z) 

at least Ri fl R 2 

Time scaling 

for m = 1, 2, 3, . . . 

X{z m ) 

(Rx) l/m 

Time shifting 
(non-causal) 

x[k — m\ 

z m X(z) 


Time shifting 

x[k — m]u[k — m] 

z"'X (c) (z) 

R x , except for the 

(causal) 


m- 1 

possible deletion or 


x[k + ni]u\k] 
x[k — m]u\k] 

z m X^\z)-z m J2x[k]z~ k 

k= 0 

m 

z ~n, X ^ (z)+z - m J2x[-k]z k 

addition of z = 0 or 
z = oo 

Frequency shifting 

e) n ° k x[k] 

X(e~ >n °z) 

A\ 

Time differencing 

x[k\ — x[k — 1] 

(1 - z-^Xfz) 

R v , except for the 
possible deletion of 
the origin 

Time accumulation 

;y[&] = x[m ] (a) 

m=0 

— f *(z ) 
d X(z) 

Rx n (|z| > l) 

z-domain 

differentiation 

kx\k] 

" dz 

Rx 

Time convolution 

x^[k} * x 2 [k] 

X,(z)X 2 (z) 

at least Ri fl R 2 

Initial-value theorem 


jc[ 0] = lim X(z) 

z-> 00 

provided x[k\ = 0 
for k < 0 

Final- value theorem 

jr [ 00 ] 

= lint a[T]= lim(z — l)X(z) 

k-> 00 z->-l 

provided jc[oo] exists 


Provided that the sequence y\k \ has a finite value for all k. 


Proof 

Using Eq. (13.7), the z-transform of a\X\[k ] + a 2 x 2 [k] is calculated as follows: 

OO 

Z{a\x\[k] + a 2 x 2 [k]} = ^ [a\X\[k] + a 2 x 2 [k]} z~ k 
k = 0 

OO OO 

= at + x 2 [k]zX k , 

k = 0 k = 0 

Xi(z) x 2 (z) 

which proves the algebraic expression, Eq. (13.16). To determine the ROC of 
the linear combination, we note that the z-transform X\ (z) is finite within the 
specified ROC, R\ . Similarly, X 2 (z) is finite within its ROC, R 2 . Therefore, the 
linear combination a\X\(z) + 02 ^ 2 ( 2 ) should be finite at least within region R 
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that represents the intersection of the two regions, i.e. R — R i Hi AS- In certain 
cases, due to the interaction between xi [A'] and which may lead to cance- 
lation of certain terms, the overall ROC R may be larger than the intersection 
of the two regions. On the other hand, if there is no common region between 
R\ and R 2 , the z-transform of { a\X\[k ] + a\X2[k\\ does not exist. 


13.4.2 Time scaling 

As mentioned in Chapter 1 , there are two types of scaling in the DT domain: 
decimation and interpolation. 

13.4.2.1 Decimation 

Because of the irreversible nature of the decimation operation, the z-transform 
of x[k] and its decimated sequence y[Ai] = x[mk] are not related to each 
other. 

13.4.2.2 Interpolation 

Section 1.3. 2. 2 defines the interpolation of x[£] as follows: 

(m) x [k/m\ if A: is a multiple of integer m 

0 otherwise. 

The z-transform of an interpolated sequence is given by the following property. 
If x[A:]^->X(z) with ROC R x , then the z-transform X t " n (z) of x^ m \k\ is given 
by 

x (rn \k]^X (m \z)=X{z m ), ROC :(R x ) 1/m (13.17) 

for 2 < m < 00 . The interpolation property is satisfied by both unilateral and 
bilateral z-transforms. 

Proof 

OO 

Z{x M [k]} = 

k = 0 

= x (ffl) [0] + JC Cm) [l]z _I + - ■ ■ + x (m) [m]z-' n + x (m V + l]z- ( "' +1) 
+ ---+x (m) [2 m]z~ 2m + --- . 

Based on Eq. (13.17), the interpolated sequence x (m '[A'] is zero everywhere 
except when A is a multiple of in. This reduces the above transform as follows: 

Z{x (ffl, [/t]} = x (m) [0] + x (m) [w]z“ m + x (m, [2 m]z~ 2m + x (m) [3 rn]z~ 3m + ■■■ . 
= x[0] + x[l ]z~ m + x[2 ]z~ 2m + x[3 ]z~ 3m + ■■■ 

OO 

= ^rW(z”)"‘ = X(z m ). 

k = 0 
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Because X{z) is finite-valued within the region z e R x , X(z m ) will have a finite 
value when z m e R x or - e (R x ) l/ ' n . 


13.4.3 Time shifting 

The time-shifting property for a bilateral z-transform is as follows. 

If x[k\ bilateral z X(z) with ROC R x , then 

x\k — ml , bilateral; . z~ m X(z\ (13.18) 

with ROC given by R x except for the possible deletion or addition of z = 0 
or z — oo. The ROC is altered because of the inclusion of the z m or z~‘" term, 
which affects the roots of the denominator D(z) in X(z). 

For causal sequences, the time-shifting property is more complicated. For 
any causal sequence x[k]u[lc] satisfying the DTFT pair 

x[k]u[k]+^X(z) 

and having the ROC R x , the unilateral z-transform of the following time-shifted 
sequences are expressed as follows (for a positive integer m)\ 

(a) x[k - m]u[k - m] ^ z~ m X(z ); (13.19) 

m — 1 

(b) x[k + m]u[k\ z m X(z) - z' n J2 x Wz~ k ’ ( 13 - 2 °) 

k = 0 

m 

(c) x[k - m]u[k] z~ m X(z ) + Z~ m (13.21) 

k = 1 

In Eqs. (13. 19)— (13.21), the ROC of the time-shifted sequences is given by R x , 
except for the possible deletion or addition of z = 0 or z = oo. 

To illustrate the three time-shifting operations, consider a two-sided sequence 
x[k ] = with |a| < 1, as illustrated in Fig. 13.4(a). Figures 1 3. 4(b)-(d) illus- 

trate the three time-shifting operations defined above in Eqs. (13.1 9)— ( 13.21) 
for m — 2. 

Proof 

We prove Eqs. (13. 19)— (13.21) separately. 

Equation (13.19) 


OO OO 

Z{x\k — m]u[k — m]} = x[k — m]u[k — m]z k = — m\z~ k 

k—0 k—m 
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Fig. 13.4. (a) Original DT 
sequence*^] = cr 1 * 1 . Parts 
(b)-(d) show sequences 
obtained by time shifting the 
sequence in part (a): 

(b) x[k — 2]u[k — 2]; 

(i c)x[k-2]u{k |; 

(d)x[k + 2]u[k]. 


x[k] = d* I 1 


a 5 a 4 a 

• « I_ 


a 2 t t a 2 , , c 

. • a ’or* a 5 . . 

4- 1 I T T T « V i 


(a) 


-5 -4 -3 -2 -1 0 1 2 3 4 5 


x[k-2]u[k] 1 


a 

a 

“ 2 T 

T “ 2 ^ 

i-L 

1 T * ■ y 


-5 -4 -3 -2 -1 0 1 2 3 4 5 


(C) 


*[A:-2]w[yt-2] ' 

a 


T “ 2 ^ 


_ L T t • y 


-5 -4 -3 -2 -1 0 1 2 3 4 5 


(b) 


x[k+2] »[A] 


“ a 4 d d a 7 , . , 

-t— f 


• a a 4 a 5 

T t . » 




-5 -4 -3 -2 -1 0 1 2 3 4 5 


(d) 


Substituting p = k — m, the above summation reduces to 

OO OO 

Z{x[k — m]u[k — m]} = Y. x[p]z~ {p+m) = z~ m ^2x[p]z~ p , = z~'"X(z). 

p = 0 p = 0 

Equation (13.20) 

OO OO 

Z{x[k + m]u[k]} = + m]u[k] z~ k = x[k + m]z~ k ■ 

k= 0 *=0 

Substituting p = k + m, the above summation reduces to 

oo oo m— 1 

Z{x[k + m]u[k]} — ^2 x[p]z~ ( ' p ~ m) = z m ^2,x[p]z~ p - z m y ^ x[p]z~ p , 

p=m p = 0 p = 0 

m— 1 

= z m X(z)-z m J2 x ^ z ~ k - 

k= 0 

Equation (13.21) 

oo oo 

Z{x[k — m]u[k\\ = x[& — m]u[k]z~ k = x[k — m]z~ k ■ 

k = o k=0 

Substituting p = k — m, the above summation reduces to 

OO 

Z{x[k - m]u[k]} = Y x[p]z~ (p+m) 

p=—m 

oo —1 

= z ~ m Y x [p ]z- p + z~ m Y x lp]z~ p . 

p= 0 p=—m 

m 

= z~ m x(z) + z~ m y^x[— k]z k . 

k= 1 
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Example 13.6 

Consider a non-causal DT sequence a' | k ] with initial values x[— 1] = 11/6 and 
x [ — 2] = 37/36. Express the z-transform of the function 

g[k] = (x[k] - 5 x[k - 1] + 6 x[k - 2 ])u[k] 

in terms of the z-transform Z{x[k]u[k]} = X(z). 

Solution 

Applying the time-shifting property, Eq. (13.21), the z-transforms of 
x[k — 1]m[£] and x[k — Z\u[k] are given by 

Z{x[k - l]u[k]} = z~ l X(z) + z~ l x[-l\z = z~ l X{z) + ^ 

6 

and 


Z{x[k - 2 ]u[k]} = z~ A X{z) + z~ z x\_-l]z + z~ z x[-2 ]z z 

a 11 , 37 

= z- 2 X(z)+—z~ 1 + —. 

6 36 

Applying the linearity property, the z-transform of g[k] is given by 
G(z) = X(z) 

= (1 -5z _1 +6j- 2 )Z(z)+ llz’ 1 -3. 



r , in 


11 , 37' 

5 

Z X(z)+ — 

D 

+ 6 

z ~X(z)+ — z + — 
6 36 


13.4.4 Time differencing 

If x[k] < " > X(z) with ROC R x , then the z-transform of the time-difference 
sequence x[k\ — x[k — 1] is given by 

x[k] - x[k - 1] (1 - z~ l )X(z), (13.22) 

with the ROC given by R x except for the possible deletion of z = 0. The time- 
differencing property can be proved easily by applying the linearity and time- 
shifting properties with m = 1 . The time-differencing property is satisfied by 
both unilateral and bilateral z-transforms. 

Example 13.7 

Based on the z-transform pair 

«WA— ' — ROC: |z| > 1, 

1 - z~ l 

calculate the z-transform of the impulse function x[k] = using the time- 
differencing property. 
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Solution 

Using the time-differencing property, the z-transform of u[k] — u[k — 1] is 
given by 

u[k] - u[k - 1] (1 - z _1 ) ■ Z{u[k]}, ROC: |z| > 1. 

Substituting the value of Z{u[k]\ = 1/(1 — z _1 ) and noting that u[k] — u[k — 
1] = <$[£], we obtain 

S[k] 1. 

Since the z-transform of the unit impulse function is finite for all values of z, 
the ROC of the aforementioned z-transform pair is the entire z-plane. 


13.4.5 z-domain differentiation 

If x[k] X(z) with ROC R x , then 

z dX(z) 

kx[k] ■> -z — — , ROC: R x . (13.23) 

dz 

The z-domain differentiation property is satisfied by both unilateral and bilateral 
z-transforms. 


Proof 

By definition, 

OO 

X(z) = J2 x Wz~ k - 

k = 0 


^ = ± m ^ = ± xm( - k)z ->-K 


Differentiating both sides with respect to z yields 

d 7 dz 

u ~ k= o u< - *=o 

Multiplying both sides by — z, we obtain 

dX(z) 


-z ■ 


dz 


= Y^kx[k]z~\ 


k = 0 


which proves Eq. (13.23). 


Example 13.8 

Given the z-transform pair 

a k u[k]^~ T , ROC: |z| > |a|, 

1 — az 1 

calculate the z-transform of the function ka k u[k]. 
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Solution 

We use the frequency-differentiation property, 


ka k x[k] 



1 

1 — az~ l 


which reduces to 


ka k x[k] 


az 


(1 — az ') 2 


ROC: |z| > |os | . 


13.4.6 Time convolution 

If jti [/:] and x 2 [k] are two arbitrary functions with the following z-transform 
pairs: 


ZtWAltf z ), ROC: R\ 

and 

x 2 [k] X 2 (z), ROC :R 2 , 

then the convolution property states that 

x\[k] * x 2 [k] Xi(z)X 2 (z), ROC: at least R\ fl R 2 . (13.24) 

The convolution property is valid for both unilateral and bilateral z-transforms. 
The overall ROC of the convolved signals may be larger than the intersection 
of regions R i and R 2 because of the possible cancelation of some poles of the 
convolved sequences. 

Proof 

By definition, the convolution of two sequences is given by 

OO 

x\[k\*x 2 [k\ = xi[m]x 2 [k — m], 

m=—o o 

Taking the z-transform of both sides yields 

OO OO 

X| [k] * x 2 [k] E E x\[m]x 2 [k — m]z k . 

k=— oo m=—o o 

By interchanging the order of the two summations on the right-hand side of the 
transform pair, we obtain 

OO OO 

xi [k] * x 2 [k] E x\[m] x 2 [k — m\z k ■ 

m——oo k=— oo 

Substituting p = k — m in the inner summation leads to 

OO OO 

x x [k]* x 2 [k]+^-+ E x 2 t p]z^ p+m) 

m=—o o P——OQ 
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or 


OO OO 

X\ [£] *x 2 [&] ^ X! ;t| W z ”’" *2 [p]z~ p , 

m =— oo p=—o o 


which proves Eq. (13.24). 

Like the DTFT convolution property discussed in Chapter 11. the time- 
convolution property of the z-transform provides us with an alternative approach 
to calculate the output y[k] when a DT sequence x[k] is applied at the input of 
an LTID system with the impulse response h[k]. The procedure for calculating 
the output y[k] of an LTID system in the complex z-domain consists of the 
following four steps. 

(1) Calculate the z-transform X(z) of the input sequence x[k]. If the input 
sequence and the impulse response are both causal functions, then the 
unilateral z-transform is used. If either of the two functions is non-causal, 
the bilateral z-transform must be used. 

(2) Calculate the z-transform H(z ) of the impulse response h[k] of the LTID 
system. The z-transform H(z) is referred to as the z-transfer function of 
the LTID system and provides a meaningful insight into the behavior of the 
system. 

(3) Based on the convolution property, the z-transform Y (z) of the resulting 
output y[k) is given by the product of the z-transforms of the input signal 
and the impulse response of the LTID system. Mathematically, this implies 
that F(z) = X(z)H(z). 

(4) Calculate the output response y [k] in the time domain by taking the inverse 
z-transform of Y (z) obtained in step (3). 

Example 13.9 

The exponential decaying sequence x[k] = a k u[k], 0 < a < 1 , is applied at the 
input of an LTID system with the impulse response h[k] — b k u[k], 0 < b < 1. 
Using the z-transform approach, calculate the output of the system. 


Solution 

Based on Table 13.1, the z-transforms for the input sequence and the impulse 
response are given by 

= r and H{z) = - ] — r. 

1 — az 1 — bz 1 

The z-transform of the output signal is, therefore, calculated as follows: 


T(z) = H(z)X(z) = 


1 

(1 - az _1 )(l — bz~ l ) 
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The inverse of Y (z) takes two different forms depending on the values of a and 
b : 

1 


Y(z) = 


(1 - az~ 1 ) 2 

1 


a — b 
a 7^ b. 


(1 - az ')(1 — bz *) 

We consider the two cases separately while calculating the inverse z-transform 
of Y(z). 

Case 1 (a —b) From Table 13.1, we know that 


ka k u[k]<—^ 


az 


-t 


(1 - az~ x ) 2 ' 
Applying the time-shifting property, we obtain 

ik+ 1 )a k+1 u[k+ 1]^» 


The output response is therefore given by 
y[k] = Z” 1 
which is the same as 


(1 - az~ 1 ) 2 


(1 - az ~ x ) 2 ' 


= (k+ l)a k u[k+ 1], 


y[k] = (k+ 1 )a k u[k]. 

Case 2 (a y^b) Using partial fraction expansion, the function Y ( z ) is expressed 
as follows: 

1 A 


Y(z) = 


B 


(1 — az *)(1 — bz *) 1 — az 1 

where the partial fraction coefficients are given by 


1 — bz 


-l ’ 


(13.25) 


A = 


1 


1 — bz 


and 


B = 


1 — az 


az ~ l = 1 


bz ~ l = 1 


a — b 


a — b 


Substituting the values of A and B into Eq. (13.25) and taking the inverse DTFT 
yields 


y[k] = 


x a k it[k] — 


a — b a — b 

Combining case 1 with case 2, we obtain 


x b k u[k] = 


1 


a — b 


[</ +1 -b k+1 ]u[k]. 


y[k] = 


a — b 


(k + \)a k u[k] 

\a k+l — b k+i ]u[k~\ a b, 

a — b 


(13.26) 


which is identical to the result of Example 11.15. 
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13.4.7 Time accumulation 


If x[k]^—*X(z) with ROC R x , then 


yj[in]A^-X(z), ROC: R x fl (|z| > 1). (13.27) 

z-\ 


Proof 

To prove the time-accumulation property, we make use of the following con- 
volution result: 


Taking the z-transform of both sides and applying the time-convolution property 
yields 


In the above equation, we substitute the z-transform of the unit step function. 


which proves Eq. (13.27). 

Example 13.10 

Given the z-transform pair 

mWA , 1 , , ROC: |z| > 1 , 

1 - z~ l 

calculate the z-transform of the function ku[k] using the time-accumulation 


Calculating the z-transform of both sides and applying the time-accumulation 
property, we obtain 


k 



m= 0 


k 


J2x[>n] X(z)Z{u[k]}. 


m = 0 



1 Z 


to obtain 


m= u 



property. 


Solution 

Note that 


k 



m= 0 


z 


1 


1 


ku[k] 


(z-l)O-z- 1 ) 1-z- 1 ’ 
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which reduces to 


_-i 


ku [A] 


(1-rT 


which can be expressed in the following alternative form: 

ku[k] - — 7 --. 

(z - l) 2 

Note that the ROC for ku[k] is the same as that for u[k\. 


13.4.8 Initial- and final-value theorems 

If x[k] X(z) with ROC R x , then 

initial-value theorem x[0] = lim X(z), provided x[A) — 0 foi' k < 0; 

Z-*- OO 

(13.28) 

final-value theorem x[oo] = lim x[k] = lim(z — I )X(z), 

k—>oo z—>l 

provided x[oo]exists. (13.29) 

Note that the initial-value theorem is valid only for the unilateral z-transform as 
it requires the reference signal x [ k ] to be zero for A: < 0. The final-value theorem, 
however, may be used with either the unilateral or bilateral z-transform. It is 
possible to get a finite value from Eq. (13.29) even though x[oo] is undefined 
or equal to infinity. Readers are advised to check that x[oo] indeed converges 
to a finite value before using the final-value theorem. This generally happens if 
all poles of (z — I )X(z.) lie inside the unit circle. 


Example 13.11 

Given the following z-transforms of right-sided sequences, determine the initial 
and final values: 


(i) *t(z) 

(ii) X 2 (z) 

(iii) X 3 (z) 


z 

z 2 - 3z + 2’ 

1 

(z — 0.1)(z — 0.5)(z + 0.2)’ 
z 2 (2z — 1.5) 

(z- l)(z — 0.5) 2 " 


Solution 

(i) Using the initial-value theorem. 


xi[0] = lim Xi(z) = lim 

z — >oo z — >oo 


3z + 2 


— lim 

z — >oo 


1 


3 + 2z 


-l 


= 0. 


Using the final-value theorem, we obtain 

z(z - 1) 


Xi[oo] = lim(z — l)Xi(z) = lim 

Z -+ 1 z-s-l 


3z ■ 


= lim 

OO 


z - 2 


= - 1 . 
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From Example 13.4 part (i), where we determined x\[k], it can be verified that 
X] [0] = 0. However, we obtain xi[oo] = oo from the result in Example 13.4, 
which is different from the result obtained above using the final-value theorem. 
Actually, in this case the final-value theorem cannot be applied as x\ [oo] is not 
finite. This can be guessed from the fact that (z — 1 )X(z) has a pole at z = 2, 
which is not inside the unit circle. 

(ii) Using the initial- value theorem. 


X 2 [ 0 ] = lim X 2 (z) = lim 

Z-> 00 Z—>OQ 


1 


(z — 0.1)(z — 0.5)(z + 0.2) _ 


= 0. 


Using the final- value theorem, 


X 2 [oo] = lim(z - l)X 2 (z) = lim 

z->-i z^i 


(z — 1) 


(z — 0.1 )(z — 0.5)(z + 0.2) 


= 0. 


From the expression of X 2 [k] derived in Example 13.4 part (ii), it can be verified 
that the above values are indeed correct. 

(iii) Using the initial- value theorem. 


x 3 [0] = lim X 3 (z) = lim 

z— > 00 z—>o o 


z 2 (2z — 1.5) 


= lim 

z — >00 


(z- l)(z — 0.5) 2 J 

2-U5Z- 1 =2 _ 


(1 - z-')(l — 0.5Z” 1 ) 2 


Using the final- value theorem. 


x 3 [oo] = lim(z • 
z-> 1 


l)X 3 (z) = lim 


(z — 1 )z 2 (2z — 1.5)' 
(z — l)(z — 0.5) 2 . 


= lim 

Z-9-1 


z 2 (2z ■ 


1.5)' 


(z - 0.5) 2 


= 2 . 


By calculating the inverse z-transform of X 3 (z), we obtain 


x 3 [k] = (2 + k x 2 ~ k )u[k). 


Based on the above expression, x 3 [0] = 2 and x 3 [oo] = 2, which are indeed 
the values obtained using the initial- and final-value theorems. 


13.5 Solution of difference equations 


An important application of the z-transform is to solve linear, constant- 
coefficient difference equations. In Section 10.1, we used a time-domain 
approach to obtain the zero-input, zero-state, and overall solutions of differ- 
ence equations. In this section, we discuss an alternative approach based on the 
z-transform. We illustrate the steps involved in the z-transform-based approach 
through Example 13.12. 
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Example 13.12 

A causal system is represented by the following difference equation: 

y[k + 2] - 5 y[k + 1] + 6 y[k] = 3 x[k + 1] + 5 x[k]. (13.30) 

Calculate the output y[k] for the input x [ k ] = 2 ~ k u[k] and the initial conditions 
y[-l] = 11/6, y[-2] = 37/36. 


Solution 

Substituting k — 2 for k in Eq. (13.30), we obtain 


y[k] - 5 y[k - 1] + 6 y[k - 2] = 3x[k - 1] + 5x[k - 2], (13.31) 

Note that the input sequence x[k ] = 2 ~ k u[k] is causal, hence jc[ — 2] = 
x[ — 1] = 0. Using the time-shifting property, Eq. (13.19), the z-transform of 
the right-hand side of Eq. (13.31) is given by 

3 x[k - 1] + 5 x[k - 2] 3z~ 1 X(z) + 5 z~ 2 X(z). 


Using the z-transform pair, 

x[k] = 2 ~ k u[k] = 0.5*m[A:] X(z) = 


1 

1 - 0.5z _1 ’ 


the z-transform of the right-hand side of Eq. (13.31) is given by 

3z _1 5z -2 3z _1 + 5z _1 


3 x[k - 1] + 5 x[k - 2] 


1 - 0.5z _1 1 - 0.5z- 


1 - 0.5z“ 


The output response is not causal as the initial conditions y[— U and v [ — 2 ] are 
not zero. We are interested in determining the causal component y[k]u\k ] of 
the response y[k]. Let us denote the z-transform of y [A:]m[&] by Y (z). Using the 
results in Example 13.6, the z-transform of the left-hand side of Eq. (13.31) is 
given by 

y[k] - 5y[k -l] + 6y[k-2]^(l- 5 z" 1 + 6 z" 2 )U(z) + (1 lz“' - 3). 


Equating the z-transforms of both sides of Eq. (13.31), we obtain 
( 1 - 5z-' + 6z -2 )E(z) + (1 lz’ 1 - 3) = 

1 - 0 .: 

which reduces to 

3 — llz -1 Sz-' + Sz" 2 


-l 


E(z) = 


1 - 5z _1 + 6z" 2 (1 - 0.5z _1 )(l - 5z _1 + 6z“ 2 ) 

(3 - llz-'Xl - 0.5z _1 ) + 3z _1 + 5z -2 

(l-o.Sz-'xi-Sz-' + ez- 2 ) 

3 - 9.5z _1 + 10.5-2 


(1 — 0.5z _1 )(l — 2z —1 )(l — 3z _1 ) ' 

Using partial fraction expansion, Y (z) can be expressed as follows: 
1 7 1 18 1 

V 


26 

y(Z,= U X 1-0.5*-' 


7 

- X — 

3 1 


■ 2z~ 


A , . 

5 1 - 3z _1 
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m 


800.19 
254 . 38 ' ' 
78.75 1 


Taking the inverse transform, we obtain 


y[k] = 


26 , 
— x 0.5 a 


roTfj T 

u 



i J J 

’ ’ ^ l The outnut resnonse is nlotted in Fi^. 1 3.5 

- 2 -i o 12 : 


5 


l x 2 k + ^ x 3 k 


for k > 0. 


Fig. 13.5. Output response of 
the LTID system specified in 
Example 13.12. 


13.6 z-transfer function of LTID systems 


In Chapters 10 and 1 1, we used the impulse response h[k] and Fourier transfer 
function H(Q) to represent an LTID system. An alternative representation for 
an LTID system is obtained by taking the z-transform of the impulse response: 

h[k] ^ H(z). 

The DTFT // (?) is referred to as the z-transfer function of the LTID system. 
In conjunction with the linear convolution property, Eq. (13.24), the z-transfer 
function H( z) may be used to determine the output response y[k] of an LTID 
system when an input sequence x [k ] is applied at its input. In the time domain, 
the output response y[k ] is given by 

y[k] = x[k]*h[k]. (13.32) 

Taking the z-transform of both sides of Eq. (13.32), we obtain 

Y(z) = X(z)H(z), (13.33) 

where Y(z) and X(z) are, respectively, the z-transforms of the output response 
y[k] and the input sequence x[k], Equation (13.33) provides us with an alter- 
native definition for the transfer function as the ratio of the z-transform of the 
output response and the z-transform of the input signal. Mathematically, the 
transfer function H( z) can be expressed as follows: 

Y(z) 

fi(z)=-^. (13.34) 

X(z) 

The z-transfer function of an LTID system can be obtained from its difference 
equation representation, as described in the following. 

Consider an LTID system whose input-output relationship is given by the 
following difference equation: 

y[k + n] + a n -iy[k + n - 1] H b floyOT 

= b m x[k + m] + b m _\x[k + m — 1] + • • • + box[k], (13.35) 

By taking the z-transform of both sides of the above equation, we obtain 

Jz" + Qn-iz” 1 + ■ ■ • + aoz}T(z) = { b m z m + b m -iz m ' + ■■• + ^o} X(z), 
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which reduces to the following transfer function: 

N r(z) b m z m + b m . l z m ~ l + ■ ■ ■ + bo 


H(z) = 


(13.36a) 


X(z) z n + a n -iz"~ l H hao 

or alternatively as 



(13.36b) 


13.6.1 Characteristic equation, poles, and zeros 


The z-transfer function plays an important role in the analysis of LTID sys- 
tems analysis. In this section, we will define a few key concepts related to the 
z-transfer function. 

Characteristic equation The characteristic equation for the transfer function, 
Eq. (13.36a), is defined as follows: 


Zeros The zeros of the transfer function H{z) of an LTID system are finite 
locations in the complex z-plane, where \H(z)\ = 0. For the transfer function, 
Eq. (13.36a), the location of the zeros can be obtained by solving the following 
equation: 


Since N(z) is an /nth-order polynomial, it will have m roots leading to in zeros. 

Poles The poles of the transfer function H(z ) of an LTID system are defined as 
locations in the complex z-plane, where H (z)| has an infinite value. The poles 
corresponding to the transfer function, Eq. (13.36a), can be obtained by solving 
the characteristic equation, Eq. (13.37). Since D{z) is an /nil-order polynomial, 
it will have n roots leading to n poles. 

Because D(z ) is an nth-order polynomial and N(z) is an /nth-order polyno- 
mial, the transfer function will have a total of n poles and m zeros. However, 
in some cases, the location of a pole may coincide with the location of a zero. 
In that case, the pole and zero will cancel each other, and the actual number 
of poles and zeros will be reduced. In order to calculate the zeros and poles, a 
transfer function is factorized and typically represented as follows: 


D{z) = a n z n + a n -iz n 1 H b a 0 = 0. 


(13.37) 


N(z) = b m z m + b m - iz m ~ l + • • • + b 0 = 0. 


(13.38) 


N(z) (z - Zl)(z - Z2) • ■ ■ (z - Zm) 


D(z) (z - PiKz - Pi) ■ ■ ■ (z - Pn) ’ 


(13.39a) 
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Im{z} 

2* 

1 


-2 -1 


-1 - 
-2 


*► Re{z} 


(a) 


Im{z} 

A 

l 

0 . 5 - 


-1 - 0.5 

- 0.5 


0.5 1 


Re{z} 


(b) 


lm{z} 



(C) 


Im{z} 

L 

0 . 5 - 


-1 - 0.5 
- 0.5 


0.5 1 


-+■ Re{z} 


(d) 

Fig. 13.6. Pole and zero plots 
for transfer functions in Example 
13.13. Plot (a) corresponds to 
part (i) of Example 13.13; plot 

(b) corresponds to part (ii); plot 

(c) corresponds to part (iii); and 
plot (d) corresponds to part 
(iv). Also note that plot (c) 
includes double zeros atz = 0 
and double poles atz = 0.5. 


or alternatively as 


-Z\Z ‘X1-Z2Z 1 )---(1 - Z m z L ) 
(1 - Piz-'XI - P2Z~ 1 )- • ‘(I - P„Z~ 1 )' 


(13.39b) 


Example 13.13 

Determine the poles and zeros of the following LTID systems: 


(i) #i(z) 

(ii) H 2 (z ) 

(iii) H 3 (z) 

(iv) H 4 (z ) 


z 

z 2 — 3z + 2 ’ 

1 

(z — 0. 1 )(z — 0.5)(z + 0.2) ’ 
z 2 (2z- 1.5) 

(z + 0.4)(z — 0.5) 2 ’ 
z 2 + 0.7z+ 1.6 
(z 2 - 1.2z+ lKz + 0.3)' 


Solution 

(i) H ] (z) = 


: 2 -3z + 2 (z — l)(z — 2) 


There is one zero, at z = 0, and two poles, at z = 1 and 2. 

1 

(ii) Ht(z) = . 

(z-0.1)(z-0.5)(z + 0.2) 

There is no zero, but there are three poles, at z = 0.1, 0.5, and —0.2. 
z 2 (2z — 1.5) 

3 " (z + 0.4)(z — 0.5) 2 ' 

There are three zeros, at z = 0, 0, and 0.75. There are three poles, at z = 
0.5, and 0.5. 

(z-0.5)(z+ 1.2) 


-0.4, 


(iv) H a (z) = 


((z - 0.6) 2 + 0.8 2 )(z + 0.3) 


(z — 0.5)(z + 1.2) 

_ (z - 0.6 + j0.8)(z - 0.6 - j0.8)(z + 0.3) ' 

There are two zeros, at z = 0.5 and —1.2. There are three poles, at z = 0.6 — 
j0.8, 0.6 + j0.8, and —0.3. 


The poles and zeros of the above four systems are shown in Fig. 13.6. In the 
plot, x marks the position of a pole and • marks the position of a zero. 


13.6.2 Determination of impulse response 

The impulse response h [k] of an LTID system can be obtained by calculating 
the inverse z-transform of the transfer function ll(z). Example 13.14 explains 
the steps involved in determining the impulse response. 
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Example 13.14 

The input-output relationship of an LTID system is given by the following 
difference equation: 

y[k + 2] - \y[k + 1] + ly[k] = 2 x[k + 2]. (13.40) 

4 o 

Determine the transfer function and the impulse response of the system. 


Solution 

Substituting m = k + 2, Eq. (13.40) can be written as follows: 

3 1 

y[m] - -y[m - 1] + -y[m] = 2 x[m], 

4 o 

Calculating the z-transform on both sides of the equation yields 
Y(z) - \z~ l Y{z ) + \z~ 2 Y(z) = 2 X(z), 


which results in the following transfer function: 


H(z) = 


Y (z) 
X(z) 


2 



1 

+ 8 Z 


-2 


To calculate the impulse response of the LTID system, consider the partial 
fraction expansion of H{z) as 


H(z) = 





By calculating the inverse z-transform of both sides, the impulse response h [A:] 
is obtained: 


h[k] =4 



k 

u[k]~ 2 


k 

u[k], 


which is identical to the result obtained by Fourier technique in Example 11.18. 


13.7 Relationship between Laplace and z-transforms 


LTID signals and systems can be considered as special cases of LTIC signals 
and systems. Therefore, the Laplace transform can also be used to analyze such 
signals and systems. In this section, we derive the relationship between the 
Laplace and z-transforms. 

If a DT sequence x[A'] is obtained by sampling a CT signal x(t) with a 
sampling interval T, the CT sampled signal xjt) may be expressed as follows: 

OO 

*s(0 = E x(kT)8(t - kT ), 

k=—o o 
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Fig. 13.7. Using Laplace 
transform techniques to analyze 
LTID systems, (a) Reference LTID 
system; (b) equivalent LTIC 
system with CT input and output 
signals. 


m 


LTID system 


► 


H{z) 


(a) 


>Ak] 


LTIC system 

I x{kT)8(t-kT) ^ 

k=~o o 

(b) 

where x(kT) are the sampled values of x(t) which equals the DT sequence x [&]. 
Calculating the Laplace transform of x s (t), we obtain 

OO OO 

X(y) = L{jt s (r)} = x(kT)L{S(t - kT)} = x(kT)e~ kTs . 

k=—o o k=—o o 

Comparing X(s ) with the z-analysis equation, 

OO 

X(z) = x Wz~ k > 

k = — oo 

it is clear that 

X(s) = X(z)\ z=e sr (13.41a) 

since x[k ] = x(kT). Equation (13.41a) illustrates the relationship between the 
Laplace transform X(s) of a sampled function and the z-transform X(z) of the 
DT sequence obtained from the samples. As illustrated in Fig. 13.7, an LTID 
system can be analyzed using an equivalent LTIC system. Figure 13.7(a) shows 
an LTID system with the z-transfer function // (z) and sequence jc | k \ applied 
at its input. The analysis of the LTID system can be completed in the s-domain 
with the LTIC system shown in Fig. 13.7(b). The transfer function of the LTIC 
system is given by 



ly(krm-kT) 

k=-°° 


H{s) = H(z)\ z=e sT (13.41b) 

and the DT input is transformed to an equivalent CT input of the form 

OO 

x s (t) = E x(kT)S(t - kT). 

k — — oo 

The output in Fig. 13.7(b) can be calculated using CT analysis techniques. The 
resulting output y(t) can then be transformed back into the DT domain using 
the relationship y\k] = x(t) at t = kT . 

Example 13.15 

A DT system is represented by the following impulse response function: 

h[k] = 0.5 s «[k]. 


(13.42) 
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(i) Determine the z-transfer function of the system. 

(ii) Determine the equivalent Laplace transfer function of the system. 

(iii) Using the Laplace domain approach, determine if the system is stable. 

Re{r} 

Solution 

(i) H(z) = Z{0.5 k u[k]} = , or — , ROC: |z| > 0.5. 

1 — 0.5z _1 z — 0.5 

(ii) Using Eq. (13.41b), the Laplace transfer function is given by 


Fig. 13.8. Location of poles in 
the s-plane for the system in 
Example 13.15 with T =0.1. 


H(s) = H(z)\ z =e*T 



(13.43) 


where T is the sampling interval. 

(iii) A causal LTIC system is stable if all the poles corresponding to the 
Laplace transfer function lie in the left-hand half of the s-plane. Therefore, we 
will first calculate the pole locations in the s-plane, and then determine if the 
system is stable. The poles of the transfer function, Eq (13.43), are calculated 
from the characteristic equation as follows: 


e sT - 0.5 = 0 e sT = 0.5 =f> e ( ' 7 ' ± j 27rm) = 0.5, 


where m =0, 1,2,... Solving for the roots of this equation yields 
1 1 

s = — [ln0.5 ±)2jtm] —[—0.693 ±)2jtm]. 

It is observed that an LTID system has an infinite number of poles in the 
s-domain. The locations of these poles for T = 0.1 are shown in Fig. 13.8. It 
is clear that these poles would lie in the left-half of the s-plane, irrespective of 
the value of the sampling interval T . The LTID system is, therefore, causal and 
stable. 

Alternatively, the stability of the LTID system can be determined from its 
impulse response by noting that 

oo oo 

\h[k]\ = J2 °- 5k = 2 < o°> 

k = — oo k =— oo 

which satisfies the BIBO stability requirement derived in Chapter 10. 


13.8 Stabilty analysis in the z-domain 


In Example 13.15, the stability of an LTID system was determined by trans- 
forming its z-transfer function H(z) to the Laplace transfer function // (,v ) of an 
equivalent LTIC system and observing if the poles of H(s) lie in the left-half 
s-plane. In this section, we derive a z-domain condition to check the stability 
of a system directly from its z-transfer function. 
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Consider a pole z = P- of an LTID system with the z-transfer function given 
by fl(z). Based on Eq. (13.41b), the location of the corresponding s-domain 
pole, s = p s , of its equivalent LTIC system H (e' 7 ) is related to the location of 
the z-domain pole, z = p z , of H(z) by the following relationship: 

Pz =e p ‘ T or p z = e Re{ ^ 7 ').e jIm!ftrl , (13.44) 

where p s T is decomposed into real and imaginary components as Re{ p s T) + 

jlmj^r}. 

We consider two different cases. Case 1 refers to a stable system, which is 
not necessarily causal, while case 2 refers to a stable and causal system. 


Case 1 Stable (not necessarily causal) LTID system The LTIC stability 
condition for a stable system H(s) is that the ROC of / / (.v ) must contain the 
vertical imaginary jcu-axis in the complex s-plane. Since the ROC cannot contain 
any pole, in terms of the pole s — p s T, this implies that Re{ p s T] ^ 0 such 
that no pole exists on the imaginary jrw-axis. Substituting Re { p, T } ^ 0 into 
Eq. (13.44) and calculating its magnitude yields 


\Pz\ = 


e Re{ p,T) 


X 


term 1^1 ifRe{p s T}^0 


term 11=1 


(13.45) 


which implies that an LTID system H(z) is stable if there is no pole on the unit 
circle of the z-plane. In terms of the ROC, it implies that the ROC must contain 
the unit circle for the system to be stable. The above condition does not assume 
the system to be causal, which is considered next. 


Case 2 Stable and causal LTID system The LTIC stability condition for 
a stable and causal system H(s ) is that all poles of H(s) must lie in the left- 
half of the complex s-plane. In terms of the pole s = p s T, this implies that 
Re{ p s T\ < 0. Substituting Re{/? v 7’j < 0 into Eq. (13.44) and taking the mag- 
nitude yields 


\Pz\ = 


a Rt{p,T}\ 


term I<1 if Re {p s T} < 0 


| gj | < L 

term 11= 1 


(13.46) 


Equation (13.46) states that an LTID system H(z) is stable if all poles lie within 
the unit circle. Alternatively, the requirement for a causal and stable LTID 
system is stated as follows. 

An LTID system will be absolutely BIBO stable and causal if and only if the 
ROC occupies the region outside and inclusive of the unit circle. In other words, 
the ROC for a stable and causal system is given by |z| > zo , with zo < 1. 


Example 13.16 

Consider the LTID systems in Example 13.13. Considering various possibilities 
of the ROC, determine if the systems are absolutely BIBO state. 

Determine if the systems are absolutely BIBO stable. 
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Solution 

(i) Since 


H\{z) = 


z 

z 2 - 3z + 2 


z 

(z- l)(z — 2) ’ 


there are two poles of the LTID system, at z = 1 and 2. Since one pole lies on 
the unit circle, the ROC cannot contain the unit circle. The LTID system //i(z) 
is therefore not absolutely BIBO stable. 

(ii) Since 


H 2 (z) = 


1 

(z — 0.1)(z — 0.5)(z + 0.2)’ 


there are three poles, at z = 0.1, 0.5, and —0.2. There are three choices for the 
ROC, which are given by 


ROC 1: |z| < 0.1. Such an implementation of the LTID system is not abso- 
lutely stable since the ROC does not contain the unit circle. 

ROC 2: 0.1 < |z| < 0.2. Such an implementation is not absolutely stable 
since the ROC does not contain the unit circle. 

ROC 3: 0.2 < |z| < 0.5. Such an implementation is not absolutely stable 
since the ROC does not contain the unit circle. 

ROC 4: |z| > 0.5. Such an implementation is absolutely stable since the 
ROC contains the unit circle. 


(iii) Since 


m(z) = 


z\2z- 1.5) 

(z + 0.4)(z - 0.5) 2 ’ 


there are three poles, at z = —0.4, 0.5, and 0.5. There are three choices for the 
ROC, which are given by 


ROC 1: |z| < 0.4. Such an implementation of the LTID system is not abso- 
lutely stable since the ROC does not contain the unit circle. 

ROC 2: 0.4 < |z| < 0.5. Such an implementation of the LTID system is not 
absolutely stable since the ROC does not contain the unit circle. 

ROC 3: |z| > 0.5. Such an implementation of the LTID system is absolutely 
stable since the ROC contains the unit circle. 


(iv) Since 

z 2 + 0.7 z + 1.6 _ (z-0.5)(z + 1.2) 

4 (z 2 - 1.2z+ l)(z + 0.3) ” (z — 0.6 + j0.8)(z — 0.6 — j0.8)(z + 0.3) ’ 

there are three poles, at z — 0.6 — j0.8, 0.6 + j0.8, and —0.3. The three choices 
of the ROC are given by 

ROC 1: |z| < 0.3. Such an implementation of the LTID system is not abso- 
lutely stable since the ROC does not contain the unit circle. 
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ROC 2: 0.3 < |z| < |0.6 ± j0.8| or 0.3 < |z| < 1. Such an implementation 
of the LTID system is not absolutely stable since the ROC does not contain 
the unit circle. 

ROC 3: |z| > |0.6 ± j0.8| or |z| > 1. Such an implementation of the LTID 
system is not absolutely stable since the ROC does not contain the unit 
circle. 


Equation (13.46) can be used to determine if a causal LTID system is absolutely 
stable. An absolutely stable and causal system has all poles inside the unit circle 
in the complex z-plane. On the contrary, if a causal system has one or more 
poles outside the unit circle then the system will not be absolutely stable. The 
impulse response of such a system includes a growing exponential function, 
making the system unstable. An intermediate case arises when a causal system 
has unrepeated poles on the unit circle and the remaining poles are inside the 
circle in the complex z-plane. Such a system is referred to as a marginally 
stable system. The condition for marginally stable and causal system is stated 
below. 

A causal system with M unrepeated poles p m — a m + j b m , 1 < m < M, on the 
unit circle (such that \p m \ = 1) and all the remaining poles inside the unit 
circle in the z-plane is stable for all bounded input signals that do not include 
complex exponential terms of the form {exp(jf? m Ai)}, with fl m = tan - 1 (b m /a m ), 
for 1 < m < M. If any of the poles on the unit circle are repeated then the LTID 
system is unstable. 

The following example demonstrates that a marginally stable system becomes 
unstable if the input signal includes a complex exponential exp(jl? m ) with 
frequency Q m — tan ~ l (b m /a m ) corresponding to the location of the pole at 
p m = a m + j b m on the unit circle in the complex z-plane. 

Example 13.17 

A causal LTID system with transfer function given by 


is a marginally stable system because of two unrepeated poles, at z = 0.5 ± 
j0.866, on the unit circle. We will demonstrate the marginal stability by calcu- 
lating the output for the following bounded input sequences: 


13.8.1 Marginal stability 



(z - 0.5 - j(V3/2))(z - 0.5 +j(V3/2)) 


1 


(i) xfk] — u[k]\ 

(ii) X 2 [A:] = sin(7Tk/3)u[k]. 
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Solution 

(i) Taking the z-transform of the input sequence, we obtain 

X1(Z)= ~^-r. 

Z - 1 

Applying the convolution property, the z-transform Y\ (z) of the output response 
is given by 

7 7 ~~ 

Y\{z) = H(z)X t (z) = 


(z - l)(z 2 - z + 1) (1 — 1 )( 1 — z 

Taking the partial fraction expansion of Yi (z) yields 

1 1 

Yi(z) = 


-l 


+ z“ 2 ) 


1 — z 1 1 - Z 1 + Z 2 

Using entries (3) and (12) of Table 13.1 (see Problem 13.5), we obtain 


m [&]•<- 


1 


1 — z 


and 


Ttk TC 


— — sin ( — — f- — J u [k] < 


1 


7-1 


+ Z' 


-2 ' 


Using the linearity property, the output y\[k] is given by 


ym = 


, Ttk 7T 

1 ~j=. sin ( — + — 

V3 


u[k]. 


Note that the output response contains a unit step function and a sinusoidal term 
and is, therefore, bounded. 

(ii) Taking the z-transform of the input sequence, we obtain 

(Vs/Dz- 1 

* _ j _2 • 

1 - z 1 + z z 

Applying the convolution property, the z-transform Yzfz) of the output response 
is given by 


Y 2 (z) = H(z)X 2 (z) = 


(V3/2 )z~ 


,-2 


1 


7-1 


+ Z“ 


1 


+ z 


-2 


(1 


(V3/2)z~ 3 

- 2\2 ' 


+ z" 2 ) : 


Using the frequency-differentiation property (see Problem 13.6), it can be 
shown that the following is a z-transform pair: 

(V3/2 )z" 3 


r 2 ■ 

,7t ,\ 

k . 

TC , 

7T\1 


- sin 

[3 

r, k ) 

- 75 sin( 

,3^ + 

e)\ 

ii 

1 

a 


+ Z~) 


— 2\2 ' 


Therefore, the output response is given by 
V2[k] = 


r 2 ■ 


k . 

71 

TC \ 

- sin 

—k ) 

— sin 

— k -)- 

— ) 

[3 

3 / 

V3 

3 

6/ 


u [k\ . 


Note that the output is a growing sinusoid function because of the k/y/ 3 scaling 
factor. Therefore, as k increases, the |y 2 [^]| increases without bound, leading 
to an unstable situation. 
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Table 13.3. Discrete frequencies corresponding to a few selected points along the unit circle in the z-domain 


z-coordi nates 1+jO -= + j^= 0+jl -= +j^= -1 +j0 -j^= 0-jl -= -j— = 

V2 v2 v2 v2 v2 v2 v2 v2 


Frequency, 1? 0 


7f/4 


n / 2 ?>n/A 


5^/4 


3?r/2 In! A 


In this example, we observe that the output response for the first input signal 
X\ [ k ] = u [k] is bounded. On the other hand, the output produced by the second 
input, X 21 1'] = s\n(jrk/3)u[k], is unbounded. Note that the second input is a 
sinusoidal sequence, which contains two complex exponentials: 



with discrete frequencies f2 m = ±ir/3. Since the frequencies of the complex 
exponentials are the same as the value of tan ~ * l 2 (b m /a m ) = tan _1 (± V3/4) = 
±tt/3, determined from the poles, at z = 0.5 ± jV3/2, on the unit circle, the 
output response is unbounded. This is consistent with the marginal stability 
condition mentioned above. 


13.9 Frequency-response calculation in the z-domain 


Based on Eq. (13.8), the DTFT transfer function is related to the z-transfer 
function by the following relationship: 

OO 

H{Q) = h[k]z~ k = H(z) | z=eM i, (13.47) 

k = — 00 

which may be used to derive the DTFT transfer function from the z-transfer 
function. Equation (13.47) has wider implications, as we discuss in the follow- 
ing. 

(1) Taking the magnitude of both sides of the relationship z = exp(j (?) gives 
|z| = 1; therefore, Eq. (13.47) is only valid if the ROC of the z-transfer 
function contains the unit circle. Otherwise, the substitution z = expljl?) 
cannot be made and the DTFT transfer function does not exist. 

(2) Equation (13.47) can also be used to compute the magnitude and phase 
spectra of the LTID system by evaluating the z-transfer function at dif- 
ferent frequencies (0 < Q < 2n) along the unit circle. The correspon- 
dence between the discrete frequency Q and the z-coordinates is shown in 
Fig. 13.9. A selected subset of the discrete frequencies along the unit circle 
is shown in Table 13.3. 

The computation of the magnitude and phase spectra from the z-transfer 
function is illustrated in the following example. 
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Fig. 13.9. Determination of the 
magnitude and phase spectra 
from the z-transfer function. 


Im{z} 




Fig. 13.10. (a) Magnitude 
spectrum and (b) phase 
spectrum of the LTID system 
considered in Example 13.18. 
The responses are shown in the 
frequency range Q = \-n, tz\. 


Example 13.18 

Consider the system with z-transfer function given by 

2z 2 2 

H(z) = 


(3/4)z + (1/8) 1 - (3/4)*- 1 + (l/8)z 


-2 ’ 


Calculate and plot the amplitude and phase spectra of the system. 


Solution 

The DTFT transfer function is given by 


H{Q) = H(z) L- =d n = 


2 

1 -(3/4)e-i« + (l/8)e-i M ' 


The magnitude spectrum and the phase spectrum <H 07) are plotted in 

Fig. 13.10, which are identical to the spectra shown in Fig. 11.18. 


13.10 DTFT and the z-transform 


In Chapter 1 1 and in this chapter, we presented two different frequency-domain 
approaches to analyze DT signals and systems. The DTFT-based approach, 
introduced in Chapter 11, uses the real frequency Q, whereas the z-transform- 
based approach uses the complex frequency a + jl7. The output response of 
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an LTID system can be computed using the convolution property of either the 
DTFT or the z-transform. In addition, the frequency-domain approach offers 
insight about the system characteristics, which is not readily available from the 
time-domain approach. However, an important issue is to determine which of 
the two transforms should be used to analyze the LTID system. Both approaches 
have their own advantages. Depending upon the application under considera- 
tion, the appropriate transform should be selected. 

Example 13.19 

Consider an LTID system represented by the unit impulse response h[k] = 
0.8 k it [k ] . Calculate the overall output and steady state output of the LTID system 
for the input sequence x[k ] = cos(nk/3)u[k]. 

Solution 


z-transform method Using Table 13.1, the z-transforms of the impulse 
response h [A:] and the input x [A:] are given by 


H(z) = 


1 

1 -0.8Z- 1 


and 


X(z) = 


1 — z 1 cos(tt/3) 

1 — 2 z _1 cos(7r/3) + z -2 


1 - 0.5z -1 
1 — z -1 + z -2 


Using the convolution property, the z-transform of the output response is given 
by 


T(z) = H(z)X(z) = 


1 - 0.5z _1 

(1 — 0.8z _1 )(l — z" 1 + z -2 )' 


By partial fraction expansion, the above expression becomes 

1 +0.5Z- 1 


YL) 7 X 1 — 0.8z _1 


5 

7 X 1 -z- 1 


2 

= - x — 

7 1 


1 


0.8z 


-l 


5 

- x — 

7 1 


1 


z 

0.5z _1 


r-l 


+ Z~ 


5 

- x — 
7 1 


Taking the inverse z-transform, the output response is given by 


y[A:] = - x 0.8*w[A:] H — x cos I — ) u[k\ + 


10 

7V3 


0.287(0.8)* 


' n k 
1.091 cos — 


0.857 r 


u[k] 


z” 1 + z -2 ’ 



where the superscript r indicates that the angle is expressed in radians. 

The steady state output y ss [k] is computed by neglecting the transient term 
(0.8)*, which decays to zero with time. The steady state output response is, 
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therefore, given by 


y ss [A:] = 1.091 cos 


7tk 

— - 0.857 


u[k]. 


DTFT method As in the CT case, the calculation of the actual output is 
difficult using the DTFT. However, the steady state value of the output can be 
easily calculated using DTFT. We have 


H(Q) = 


1 

1 - 0.8e-j«' 


The value of the DTFT transfer function at Q = tt/3, the fundamental frequency 
of the sinusoidal input, is given by 

t _ o.ge-jt^aj = 0-714 -j0.285 = 1.091e^ 857 , 


implying that \H(Q)\ = 1.091 and <H{fi) — —0.857 radians. Therefore, the 
steady state output response is given by 

y ss [k] = \H{(7)\ x C0S f~Y + <H(fi)\u[k] 


= 1.091 cosf— 

V 3 


0.857 r )u[k]. 


Example 13.19 shows that the z-transform is a more convenient tool for tran- 
sient analysis. For the steady state analysis, the z-transform does not offer much 
advantage over the DTFT. In signal processing applications, such as audio, 
image and video processing, the transients are generally ignored. In such appli- 
cations, the DTFT is sufficient to analyze the steady state response. On the 
other hand, the transient analysis is important for applications such as control 
systems and process control. This is precisely the reason for the widespread use 
of the z-transform in digital control and system design, whereas the DTFT is 
preferred in signal processing applications. 


13.11 Experiments with Mat lab 


M ATLAB provides several M-files for working with z-transforms. In this sec- 
tion, we explore five important functions, residuez , residue, tf 2zp, 
zp2 tf , and zplane. To illustrate the application of these M-files, we consider 
the following linear, constant-coefficient difference equation representation: 

a„y[k] + a n -\y[k — 1] H b aoy[k - n] — b m x[k] + b m -\x[k — 1] H 

+ box[k ~ /n], 

for modeling the relationship between the input sequence x[k ] and output 
response y[£] of an LTID system. The above equation is a more general case 
of Eq. (13.35), where a„ was set to 1. Recall that Section 10.9 covered the 
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Matlab file filter used to compute the output response y\k\ from spec- 
ified sample values of the input sequence x[k\ and the ancillary conditions. In 
this section, we focus on the z-transfer function representation. 


H(z) = 


Y(z) 

XU) 


b, n + fr„,_iz 1 H h b 0 z m 

a„ + a„_iz _1 H \-a 0 z~" 


(13.48) 


which can also be factorized as follows: 


H(z) = 


Y(z ) _ (1 - zoz ^(l-ziz 1 )---(1 - zmz *) 

X(z) (1 - poz~ l )(l - p iz” 1 )- • • (1 - pnz~ 1 )' 


(13.49) 


Since Matlab assumes that the numerator and denominator of the z-transfer 
function are expressed in increasing powers of z , we prefer the aforemen- 
tioned format for the z-transfer function. 


13.11.1 Partial fraction expansion 

To calculate the partial fraction expansion of a rational z-transfer function, 
Matlab provides the residuez function, which has the following syntax: 

» [R,P,K] = residuez (B, A) ; 

In terms of the transfer function in Eq. (13.48), the input variables B and A are 
defined as follows: 

A = [a„ a n - 1 . . . a 0 ] and B = [b m b m - \ ...b 0 ]. 

The output parameter R returns the values of the partial fraction coefficients, 
P returns the location of the poles, while K contains the direct term in the row 
vector. 


Example 13.20 

To illustrate the usage of the built-in function residuez, let us calculate the 
partial fraction expansion of the z-transfer function. 


H(z) = 


2z(3z + 17) 

(z- l)(z 2 — 6z + 25)’ 


considered in Example 13.4(iii). 


Solution 

Expressing the z-transfer function in increasing powers of z -1 yields 

6z~* + 34z -2 

1 -7z-‘ +31z- 2 -25z- 3 ' 


H(z) = 
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The M ATL AB code to determine the partial fraction expansion is given below. 
The explanation follows each instruction in the form of comments. 

» B = [0 ; 6 ; 34 ; 0] ; % Coeff . of the numerator N(z) 

» A = [1; -7; 31; -25] ; % Coeff. of the denominator D(z) 

» [R,P,K] = residuez (B , A) % Calc, partial fraction expansion 

The returned values are given by 

R = [-1.0000-1.2500j, -1.0000+1.2500:, 2.0000] 

P= [3.0000+4.0000:, 3.0000-4.0000:, 1.0000] and K= [] . 

The transfer function H(z ) can therefore be expressed as follows: 

— 1 — j 1.25 -l+jl.25 2 

W ~~ 1 — (3 + j4)z _1 l-O-j^z- 1 1 -z- 1 ' 

Alternative partial fraction expansion Sometimes, it is desirable to perform 
the partial fraction in terms of the polynomials of z, instead of the polynomials 
of z _1 . In such cases, the Matlab function residue is used. We solve 
Example 13.20 in terms of the alternative expression for the transfer function, 

H(z) _ 6z + 34 
~z~ “ z 3 — lz 2 + 31z — 25 ' 

The Matlab code to determine the partial fraction expansion of the alternative 
expression is given below. As before, the explanation follows each instruction 
in the form of comments. 

>> B = [0; 0; 6; 34] ; % Coeff. of the numerator N(z) 

» A = [1; -7; 31; -25]; % Coeff. of the D(z) 

>> [R,P,K] = residue(B,A) % Calc, partial fraction expansion 

The returned values are given by 

R = [-1.0000-1.2500:, -1.0000+1.2500:, 2.0000] 

P= [3.0000+4.0000:, 3.0000-4.0000:, 1.0000] and K = [] . 

The transfer function H(z) can therefore be expressed as follows: 

H(z) _ -1 — jl.25 -l+jl.25 2 

z z — (3+j4) + z — (3 — j4) + z- r 

which is the same as result obtained in Example 13.4(iii). 


13.11.2 Computing poles and zeros from the z-transfer function 

Matlab provides the built-in function tf 2 zp to calculate the location of the 
poles and zeros from the z-transfer function. Another function zplane can be 
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used to plot the poles and zeros in the complex z-plane. In terms of Eq. (13.48), 
the syntaxes for these functions are given by 

» [Z,P,K] = tf2zp(B,A); % Calculate poles and zeros 

» zplane(Z,P); % plot poles and zeros, 

where the input variables B and A are defined as follows: 

A = [a„ a n -i ...a 0 ] and B = [b m b m -i . . . b 0 ] . 

They are obtained from the transfer function given in Eq. (13.48). The vector 
Z contains the location of the zeros, vector P contains the location of the poles, 
while K returns a scalar providing the gain of the numerator. 

Example 13.21 

For the z-transfer function 


H(z) = 


2z(3z + 17) 

(z — l)(z 2 — 6z + 25)’ 


compute the poles and zeros and give a sketch of their locations in the complex 
z-plane. 


Solution 

The M A T L A B code to determine the location of zeros and poles is listed below. 
The explanation follows each instruction in the form of comments. 

>> B = [0 , 6 , 34 , 0] ; % Coefficients of the numerator N(z) 

>>A= [1, -7, 31, -25]; % Coefficients of the denominator D(z) 

» [Z,P,K] = tf2zp(B,A) % Calculate poles and zeros 

» zplane(Z,P) % plot poles and zeros 


The returned values are given by 
Z = [0, -5.6667] , 

P = [3 . 0000+4 . OOOOj 3. 0000-4. OOOOj 1.0000] and K = 6. 

The transfer function H{z) can therefore be expressed as follows: 

= z(z + 5.6667) 

(z — (3+j4))(z — (3 — j4))(z — 1) 
z -1 (l + 5.6667z _1 ) 

“ (1 - (3 +j4)z— ')(1 - (3 — j4)z _1 )(l - z- 1 )' 

The pole-zero plot for H{z ) is shown in Fig. 13.11. 
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Fig. 13.11. Location of poles and 
zeros obtained in Example 13.21 
using Matlab 



real part 


13.11.3 Computing the z-transfer function from poles and zeros 

Matlab provides the built-in function zp2tf to calculate the z-transfer 
function from poles and zeros. In terms of Eq. (13.49), the syntax for zp2 tf 
is given by 

» [B , A] = zp2tf (Z, P, K) ; % Calculate poles and zeros 

where vector Z contains the location of the zeros, vector P contains the location 
of the poles, and K is a scalar providing the gain of the numerator. The numerator 
coefficients are returned in B and the denominator coefficients in A. 


Example 13.22 

Consider the poles and zeros calculated in Example 13.21. Using the values of 
the poles and, zeros and the gain factor, determine the transfer function H(z). 


Solution 

The Matlab code to determine the coefficients of the transfer function is 
listed below. The explanation follows each instruction in the form of comments. 


» Z = [0; -5.666667] ; 

>> P = [3+4 * j; 3-4 * j; 1] ; 
» K = 6 ; 

» [B , A] = zp2 tf ( Z , P , K) ; 

The returned values are given by 

B = [0 6 34 0] and 


% Zeros in a column vector 
% Poles in a column vector 
% Gain of the numerator 
% Calculate poles and zeros 


A = [1 -731 -25] , 


which implies that the transfer function is given by 

6 z 2 + 34 z 

z 3 — lz 2 + 31z — 25 ’ 


H(z) = 
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The aforementioned expression is identical to the transfer function specified in 
Example 13.21. 


13.12 Summary 


In this chapter, we defined the bilateral z-transform for DT sequences as follows: 

OO 

z-analysis equation X(z) = S{jc[fc]e _cri } = x[k\z~ k ■ 

k=—oo 

z-synthesis equation x[k ] = ([> X(z)z* _1 dz. 

2n) J 

c 

Unlike the DTFT, which requires the DT sequences to be absolutely summable 
for the DTFT to exist, the z-transform exists for a much larger set of DT 
sequences. Associated with the bilateral z-transform is a region of convergence 
(ROC) in the complex z-plane over which the z-transform is defined. 

For causal sequences, the bilateral z-transform simplifies to the unilateral 
z-transform, defined in Section 13.2 as follows: 

OO 

unilateral z-transform X(z) = x[k]z ~ k . 

k = 0 

Section 13.3 introduced the look-up table, the partial fraction expansion, and 
the power-series-based approaches for determining the inverse z-transform of 
a rational function. 

Section 13.4 presented the properties of the z-transform, which are summa- 
rized in the following. 

(1) The linearity property states that the overall z-transform of a linear com- 
bination of DT sequences is given by the same linear combination of the 
individual z-transforms. 

(2) The time-scaling property is only applicable for time-expanded (or inter- 
polated) sequences. The time-scaling property states that interpolating a 
sequence in the time domain compresses its z-transform in the complex 
z-domain. 

(3) The time-shifting property states that shifting a sequence in the time domain 
towards the right-hand side by an integer constant m is equivalent to mul- 
tiplying the z-transform of the original sequence by a complex term z~ m . 
Similarly, shifting towards the left-hand side by integer m is equivalent to 
multiplying the z-transform of the original sequence with a complex term 
z m . 

(4) Time differencing is defined as the difference between an original sequence 
and its time-shifted version with a shift of one sample towards the right- 
hand side. The time-differencing property states that time-differencing a 
signal in the time domain is equivalent to multiplying its DTFT by a factor 
of (1 - z _1 ). 
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(5) The z-domain-differentiation property states that differentiating the z- 
transform with respect to z and then multiplying with the variable — z 
is equivalent to multiplying the original sequence by a factor of k. 

(6) The time-convolution property states that the convolution of two DT 
sequences is equivalent to the multiplication of the z-transforms of the 
two sequences in the z-domain. 

(7) The time-accumulation property is the converse of the time-differencing 
property. The accumulation property states that the z-transform of the run- 
ning sum of a sequence is obtained by multiplying the z-transform of the 
original sequence by a factor of z/(z — 1). 

(8) The initial- and final-value theorems can be used to determine the initial 
value at k = 0 and final value at k — > oo directly from the z-transform of 
a DT sequence. 

Section 13.5 covered the application of the z-transform in solving finite- 
difference equations and showed how the z-transfer function can be obtained 
from a difference equation of the following form: 

_ Y(z) _ b m + b m -\z~ l H h b 0 z~ m 

X(z) a n + -( h a 0 z~ n 

Section 13.6 defined the characteristic equation, poles, and zeros of an LTID 
system from the above rational expression of the z-transfer function. The char- 
acteristic equation for the transfer function is based on the denominator D(z) 
of the z-transfer function H(z ) and is defined as follows: 

D(z) — a n z n + ci n - \z n 1 + • • • + ciq = 0. 

The roots of the characteristic equation define the poles of the LTID system as 
locations in the complex z-plane, where |//(z)| has an infinite value. Similarly, 
the zeros of the transfer function H(z) of an LTID system are finite locations 
in the complex z-plane where |//(z)| approaches zero. If N(z) is the numerator 
of H (z), the zeros can be obtained by calculating the roots of the following 
equation: 

N(z) = b m z m + b m -iz m + ■ ■ • + bo = 0. 

Sections 13.7 and 13. 8 exploited the relationship be tween the z-transfer function 
H(z) of an LTID system and the Laplace transfer function H f.v) of an equivalent 
LTIC system to derive the stability conditions for a causal and stable LTID 
system. 

Section 13.9 showed how the magnitude and phase spectra can be obtained 
directly from the z-transform, while Section 13.10 compared the z-transfer- 
function-based analysis techniques with those based on the DTFT transfer 
function. We showed that the z-transform is a more convenient tool for transient 
analysis, while the DTFT is more appropriate for steady state analysis. 

Finally, Section 13.11 illustrated some Matlab library functions used to 
analyze the LTID systems in the complex z-domain. 
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Problems 


13.1 Calculate the bilateral z-transform of the following non-causal functions: 

(i) xi[k] = 0.5 i+1 «[A: + 5]; 

(ii) x 2 [k\ = (k + 2)0.5 W ; 

(iii) x 3 [k] = \k + 2\x 0.5 |i+21 ; 


(iv) X4 [k] = 3 


-^' +1 cos (-k-- 


) «[- 


■k + 5]. 


V 3 4- 

13.2 Calculate the unilateral z-transform of the following causal functions: 
1 k = 10, 11 

(i) xi [k] = 2 it = 12, 15 

0 otherwise; 

4 

(ii) x 2 [k] = 3 ~ k+2 u[k] + J2 mS i k - m \- 

m = 1 

' nk 7t ' 


(iii) x 3 [k] = sin ( — + - ) u[k]; 


irk 


71 


(iv) X4 [k] = 2 k sin ( — — f — ) u[k]\ 

(v) X 5 [t] = ku[k], 

13.3 Using the partial fraction method, calculate the inverse z-transform of the 
following DT causal sequences: 

(i) Xi(z) = 


(ii) X 2 (z) = 

(iii) X 3 (z) = 

(iv) X 4 (z) = 

(v) X 5 (z) = 

(vi) X 6 (z) = 

(vii) X 7 (z) = 


z 2 — 0.9z + 0.2’ 

z 

z 2 -2Az + 0.2’ 
z 2 + 2 


( z — 0.3)(z + 0.4)(z ■ 

z 2 + 2 

(z — 0.3)(z + 0.4) 2 ’ 
4Z- 1 


0.7)’ 


1 


5 z _1 + 6z~ 2 ’ 
4z~ 2 

10-6(z 1 +z~ 1 )’ 
2 z~ 2 


(1 -4z~ 1 ) 2 (l -2Z- 1 )' 

13.4 Using the power series expansion method, calculate the inverse 
z-transform of the DT causal sequences in Problem 13.3 for the first 
five non- zero values. 

13.5 (a) Prove entry (12) of Table 13.1. (b) Using the proved result, derive the 
following z-transform pair used in Example 13. 17(i): 


irk 


IT 


— sin ( — + — ) u[k ] 


1 

~ 


+ z 


-2 ‘ 
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13.6 


(a) Using the z-domain-differentiation property and pairs (9) and (12) 
in Table 13.1, show that 


(i) k sin(l?oA:)n[A:]^-> 

(ii) k sin(l?oA: + 9)u[k] 


z(z 2 - 1) sin U 0 


(z 2 


- 2zcos l?o + l) 2 
z[sin(U o +0)z 2 — 2z sin0 


ROC: |z| > 1; 

sin(t?o — 9)] 


(. z 2 - 2zcosU 0 + l) 2 


ROC: | z | > 1. 

(b) Using the above result, or otherwise, prove the following z-transform 
pair used in Example 13.17 (ii): 


r 2 . 


k . 


7T \ I 


- sin 
[3 

3 k ) 

-7=3 sm{ 

3 k + 

e)\ 

u[k] < — 1 — > 


(V3/2 )z“ 3 


(1 - Z" 1 + z~ 2 ) 2 ’ 


ROC: 


> 1 . 


(V3/2 )z 
(z 2 - z + l) 2 


13.7 Using the time-shifting property and the results in Example 13.3(v), 
calculate the z-transform of the following function: 


g[k] = 


1 k = 10, 1 1 

2 k = 12, 15 
0 otherwise. 


13.8 Prove the initial-value theorem stated in Section 13.4.8. 

13.9 Prove the final-value theorem stated in Section 13.4.8. 

13.10 Determine the z-transform of the following sequences using the specified 
property: 

(i) x[k ] = (5/6) k u[k — 6], based on the z-transform pair (4) in Table 
13.1 and the time-shifting property; 

(ii) x[k ] = k(2/9) k u[k], based on the z-transform pair (4) in Table 13.1 
and the z-domain differentiation property; 

(iii) x[k ] = ku(k), based on the z-transform pair (3) in Table 13.1 and 
the accumulation property; 

(iv) x[k] = e k sin(£)«[fc], based on the z-transform pair (4) in Table 13.1 
and the linearity property. 

13.11 By selecting different ROCs, calculate four possible impulse responses 
of the transfer function 


(1 - 0.5z _I )(l - 0.75z-')(l - 1.25z -1 )’ 

Determine the impulse response of the system that is stable. Is it causal? 
Why or why not? 


13.12 You are given the unit impulse response of an LTID system, 

h[k] = 5 ~ k u[k]. 
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(i) Determine the impulse response h my [k] of the inverse system that 
satisfies the property 

h mv [k]*h[k\ = 8[k]. 

(ii) Using any method, obtain the output y[A] of the original system 
h[k] for each of the following inputs: (a) x\[k] — u[k\, (b) xo [A] = 
55 [A - 4] - 28[k + 4]; and (c) x 3 [A] = e (k+2) u[-k + 2], 

13.13 You are hired by a signal processing firm and you are hoping to impress 
them with the skills that you have acquired in this course. The firm asks 
you to design an LTID system that has the property that if the input is 
given by 

x[k] = (1/3/ u[k] - (1/4)* -1 u[k], 
the output is given by 

y[k] = a/4) k u[k]. 

(i) Determine the z-transfer function of the LTID system. 

(ii) Determine the impulse response of the LTID system. 

(iii) Determine the difference-equation representation of the LTID sys- 
tem. 

13.14 The transfer function of a physically realizable system is as follows: 

1 

HU ~ (1 - 0.3z _1 )(l - 0.5z _1 )(l - 0.7-- 1 )' 

(i) Determine the impulse response of the LTID system. 

(ii) Determine the difference-equation representation of the LTID sys- 
tem. 

(iii) Determine the unit step response of the LTID system by using the 
time-convolution property of the z-transform. 

(iv) Determine the unit step response of the LTID system by convolv- 
ing the unit step sequence with the impulse response obtained in 
part (i). 

13.15 Given the difference equation 

y[k] + y[k - 1] + l -y[k - 2] = x[A] - x[A - 2], 

(i) determine the transfer function representing the LTID system; 

(ii) determine the impulse response of the LTID system; 

(iii) determine the output of the LTID system to the input x[A] = 
(1/2 /m[A] using the time-convolution property; 

(iv) determine the output of the LTID system by convolving the input 
x [A] = (1/2 /m[A] with the impulse response obtained in part (ii). 
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13.16 Determine the output response of the following LTID systems with the 
specified inputs and impulse responses: 

(i) x[k] = u[k + 2] — u[— k — 3] and h[k] — u[k — 5] — u[k — 6]; 

(ii) x[k] = u[k] = u[k- 9] and h[k] = 3 ~ k u[k - 4 ]; 

(iii) x\k\ = 2~ k u[k] and h[k] = k(u[k] - u[k - 4]); 

(iv) x[k ] = u[k] and h[k] — 4~^; 

(v) x[k] = 2 ~ k u[k] and h[k] = 2 k u[-k - 1], 

13.17 When the DT sequence 

x[k] = (1/4/ u[k] + (1/3)‘«W 

is applied at the input of a causal LTID system, the output response is 
given by 


y[k] = 2(l/4) k u[k]- 4(3/4? u[k]. 


(i) Determine the z-transfer function H(z) of the LTID system. 

(ii) Determine the impulse response h[k] of the LTID system. 

(iii) Determine the difference-equation representation of the LTID sys- 
tem. 


13.18 Consider an LTIC system with the following transfer function: 


H(s) = 


e 


sT 


e sT -0.3' 


Calculate the output response y(t) of the LTIC system for the following 
input sequence: 

OO 

/(f) = J]( 0.2) kT Sd-kT). 

k = 0 


13.19 Plot the poles and zeros of the following LTID systems. Assuming that 
the systems are causal, determine if the systems are BIBO stable. 
z — 2 

(i) H(z) = 


(ii) H(z) = 

(iii) H(z) = 


(z - 0.6 +j0.8)(z 2 + 0.25)’ 
(z - 2 )(z - 1) 

(z 2 — 2.5z + 1 )(z 2 + 0.25) ’ 
z — 0.2 


(z + 0.1)(z 2 + 4)’ 


(iv) H(z ) = z 1 - 2z 2 + z 


— 3 . 


(v) H(z) = 

(vi) H(z) = 


(z 2 + 2.5z + 0.9+j0.15)z 


z 3 + (1.8 + j0.3)z 2 + (0.6 + j0.6)z - 0.2 + j0.3 ’ 
z 3 - 1.2z 2 + 2.5z + 0.8 

z 6 + 0.3z 5 + 0.23z 4 + 0.209z 3 + 0.1066- 2 - 0.04162- - 0.07134' 
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13.20 Consider an LTID system with the following transfer function: 


(i) Using Matlab , calculate the frequency response H (e jr 'j for Q = 
[— n :it /20 : tt J . Plot the amplitude and phase spectra. 

(ii) IftheDT signal x[k \ = 5 cos(7rA:/10) is passed through the system, 
what will be the steady state output of the system? 

13.21 (a) Using Matlab, determine the poles and zeros of the z-transfer 
functions specified in Problem 13.19. (b) Plot the location of poles and 
zeros in the complex z-plane using Matlab . 

13.22 (a) Using Matlab, determine the partial fraction expansion of the 
z-transfer functions specified in Problem 13.19. (b) From the par- 
tial fraction expansion, calculate the impulse response function of the 
systems. 

13.23 Assume that the functions in Problem 13.3 are z-transfer functions of 
some causal LTID systems, (a) Using Matlab , determine the impulse 
responses of these systems, (b) Plot the impulse responses. 


CHAPTER 


14 Digital filters 


A digital filter is defined as a system that transforms a sequence, applied at 
the input of the filter, by changing its frequency characteristics in a predefined 
manner. A convenient classification of digital filters is obtained by specifying the 
shape of their magnitude and phase spectra in the frequency domain. Based on 
the magnitude response, digital filters are classified in four important categories: 
lowpass, highpass, bandpass, and bandstop. A lowpass filter removes the higher- 
frequency components from an input sequence and is widely used to smooth out 
any sharp changes present in the sequence. An example of lowpass filtering is the 
elimination of the hissing noise present in magnetic audio cassettes. Since the 
background hissing noise contains higher-frequency components than the music 
itself, a lowpass filter removes the hissing noise. A highpass filter eliminates the 
lower-frequency components and tends to emphasize sharp transitions in the 
input sequence. An application of highpass filtering is the detection of edges of 
different objects present in still images. While eliminating the smooth regions, 
represented by low frequencies, within each object, a highpass filter retains 
the boundaries between the objects. A bandpass filter allows a selected range 
of frequencies, referred to as the pass band, within the input sequence to be 
preserved at the output of the filter. All frequencies outside the pass band are 
eliminated from the input sequence. Bandpass filters are used, for example, 
in detecting the dual-tone multifrequency (DTMF) signals in digital telephone 
systems. As shown in Fig. 14.1, each DTMF key is represented by a pair of 
frequencies. At the receiver, a bank of bandpass filters, each tuned to one of the 
seven frequencies specified in Fig. 14.1, is used to determine the pressed key 
by isolating the pair of frequencies present in the transmitted signal. Bandstop 
filters are the converse of bandpass filters and allow all frequencies, except those 
in a specified stop band, to be retained at the output. An application of bandstop 
filters is to eliminate narrow-band noise, seen as bright and dark blotches in 
digital videos. 

This chapter focuses on digital filters and introduces the basic filtering 
concepts and implementations useful in the design of digital filters. Sec- 
tion 14.1 describes four categories of frequency-selective filters, based on the 
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Fig. 14.1. Dual-tone 
multifrequency (DTMF) signals 
used in digital telephone 
systems. 


magnitude characteristics of the transfer function A second classifica- 

tion of digital filters is made on the basis of the length of the impulse response 
h[k] and is covered in Section 14.2. Yet another classification of digital filters 
is made on the basis of the linearity of the phase <//(■!?), which is presented 
in Section 14.3. The impulse response of the ideal frequency-selective filters, 
considered in Section 14.1, is infinite, which makes them physically unreal- 
izable. Section 14.4 describes realizable implementations of the ideal filters, 
which are causal. Sections 14.5-14.7 cover physical implementations of digital 
filters using special-purpose hardware confined to delays, adders, and scalar 
multipliers. During the actual implementation of digital filters in software or 
hardware, the filter coefficients can only be represented with finite precision. 
The impact of finite-precision arithmetic on the performance of digital filters 
is covered in Section 14.8. Important Matlab library functions used in the 
analysis of digital filters are presented in Section 14.9. Finally, Section 14.9 
concludes the chapter with summary of the important concepts. 


14.1 Filter classification 


A digital filter is often classified on the basis of the magnitude and phase spectra 
derived from its transfer function. In this section, we consider a classification 
based on the shape of the magnitude spectrum of the filter. In the case of ideal 
filters, the shape of the magnitude spectrum is rectangular with a sharp transition 
between the range of frequencies passed and the range of frequencies blocked 
by the filter. The range of frequencies passed by the filter is referred to as the 
pass band of the filter, while the range of blocked frequencies is referred to as 
the stop band. 

14.1.1 Ideal lowpass filter 

The transfer function //;i p (i7) of an ideal lowpass filter, with a cut-off frequency 
of f? c , is given by 


ffiip(fl) = 


1 

0 


\n\ < n c 

n c < \n\ < jr, 


(14.1a) 


which has a pass band of 1 17| < l? c and a stop band of 12 c < | fi\ < jt. Since the 
frequency Q = n is the highest frequency present in the DTFT, the lowpass filter 
removes the higher frequencies in the range of 12 c < | fi\ < tc . The magnitude 
response of the lowpass filter is shown in Fig. 14.2(a). It is observed that the 
lowpass filter has a unity gain in the pass band and zero gain in the stop band. 
Sometimes, a lowpass filter has a pass band gain different from unity. If the 
gain is greater than one, the pass band signal is amplified, if the gain is less than 
one, the pass band signal is attenuated. 



Hi lp (fl) 


->n 


1 





► 


-a. o lx 


-lx o a. 


(a) 


~ n ~&c2 

(c) 


(b) 



1 







► 



1 

H ibs (L2) 






► 


"Pel 0 flcl ^c2 * 


-71 -n a -L2 cl o LX, n c2 71 
(d) 

Fig. 14.2. Magnitude response of ideal filters, (a) Lowpass filter; (b) highpass filter; (c) bandpass filter; 
(d) bandstop filter. 


The impulse response /qi p [k] of the ideal lowpass filter is obtained by calcu- 
lating the inverse DTFT of Eq. (14.1a) and is given by 


sin(k.!7 c ) 17, 

h\\ v \k\ = — ; = — sine 


kit 7T 


( ki ? c \ 


(14.1b) 


14.1.2 Ideal highpass filter 


The transfer function //ih P (l7) of an ideal highpass filter, with a cut-off frequency 
of 17 c , is given by 


H ihp (f2) = 


0 

1 


|i?| < 17 c 
17 c < ]17| < n. 


(14.2a) 


which has a pass band of J? c < |J7| < 7r and a stop band of |i?| < 17 c . From 
the magnitude response of the highpass filter shown in Fig. 14.2(b), it is clear 
that the highpass filter blocks the lower frequencies | fl\ < i? c , while the higher 
frequencies 17 C < 1 17| < 7T are passed with a unity gain. 

The transfer function H\ h p (l2) of an ideal highpass filter is related to the 
transfer function Hn v (f2) of an ideal lowpass filter as follows: 


7/ ihp (17) = 1 - ffii p (fl), (14.2b) 

provided that the cut-off frequencies 17 C of both filters are the same. Calculating 
the inverse DTFT of Eq. (14.2b), the impulse response /qt, p [k] of the ideal 
highpass filter is obtained: 


hitp[k] = S[k] - hn p [k]. 


(14.3a) 


Substituting the expression for hi\ p [k] given in Eq. (14.1b) into the above equa- 
tion, the impulse response h\b p [k] can be expressed as follows: 


Aihp[*J = m - /hip [k] = «[*] - 


Q c 

— sine 

TT 



(14.3b) 


14.1.3 Ideal bandpass filter 


The transfer function //;b p (f2) of an ideal bandpass filter, with cut-off frequencies 
of i? c i and J? C 2, is given by 


H ibp (f2) = 


1 

0 


n ci < \o\ < n c2 

T? c i < \fi\ and 1? C 2 < \fi\ < n, 


(14.4a) 


which has a pass band of l7 c i < \fi\ < /2 c2 and a stop band of | i7| < l? cI and 
f? c 2 < | J?| < tc . The magnitude response of the ideal bandpass filter is shown 
in Fig. 14.2(c). 

The transfer function //jb p (!7) is expressed in terms of the transfer functions 
of two ideal lowpass filters: 


H ihp (f2) = 


cut-off freq= 


i"?c2 




cut-off fieq= f2 zl 


(14.4b) 


Calculating the inverse DTFT of Eq. (14.4a), the impulse response hib P [k] of 
the ideal bandpass filter can be expressed as follows: 


^ibpM — ^ii P iM| fic= j7 c2 h ilp2 [k]\ n ^ ai . (14.4c) 

Substituting the expression for hi\ p [k] given in Eq. (14.1b) into the above equa- 
tion, the impulse response hib P [k] of the ideal bandpass filter can be expressed 
as follows: 


'c2 

hib P [k] = — 1 sine 

7T 


kf^c2 \ r2ci 


- 


TT 


kf] c 


TT 


(14.4d) 


Equation. (14.4b) shows that a bandpass filter can be formed by a parallel 
configuration of two lowpass filters. The first lowpass filter in the parallel con- 
figuration should have a cut-off frequency of 1? C 2, while the second lowpass 
filter has a cut-off frequency of l? c i . Other configurations of bandpass filters 
are also possible, such as a series combination of a lowpass and a highpass 
filter. 


14.1.4 Ideal bandstop filter 


The transfer function Hn, s (f2) of an ideal bandstop filter, with cut-off frequencies 
l7 c i and _O c 2, is given by 


# ibs (l?) = 


0 

1 


ftcl < \^\ < f^c2 

\fl\ < 17 c i and 1? C 2 < |i?| <tt, 


(14.5a) 


which has a pass band of \Q\ < J2 c i and l? c 2 < \ fi\ < jt and a stop band of 
ftci < - A — f? C 2- The magnitude response of the ideal bandstop filter is shown 
in Fig. 14.2(d). 


Table 14.1. Impulse response of ideal lowpass, highpass, bandpass, and bandstop 
filters in terms of normalized cut-off frequencies, rZ/7 — 

The pass-band gain is assumed to be unity. For bandpass and bandstop filters, there 
are two cut-off frequencies, and n nl > <>„ , 


Filter Normalized cut- 

Type off frequency Ideal filter impulse response 


Lowpass A2 n 
Highpass A2 n 
Bandpass fZ„i,fZ n 2 
Bandstop L2 nl , L2 n2 


hn v [k] = fi a sinc[A12 n ] 

/j;ip[A] = 5 [At] — 12 n sinc[Af2„] 

h ibp [A] = f2 „ 2 sinc[Al2 n2 ] — 12 n i sinc[Af2„i] 

h ibs [k] = 5[A] — n „2 sinc[A 12 n 2 ] + 12 n i sinc[Al2 nl ] 


The transfer function Hfo s (f2) of an ideal bandstop filter is related to the 
transfer function Ha, p (f2) of an ideal bandpass filter by 

H ibs (Q) = 1 - H lhp (Q), (14.5b) 

provided that the the cut-off frequencies fi c \ and Q c 2 of both filters are the same. 
Calculating the inverse DTFT of Eq. (14.5b), the impulse response /qbsOT of 
the ideal bandstop filter is obtained: 


h ibs [k] = S[k]-h ibp [k]\ f!Mci 

= m = h M m\^ Qdi -h ilvl [k]\ (ic=Sici 

k f^c2 


(14.6) 


= 8 [k] sine 

TT 


IT 


f^ci . { k£2 ci 

sine I 

7T \ JT 


Equation (14.6) shows that a bandstop filter can be formed by a parallel con- 
figuration of two lowpass filters having cut-off frequencies i ? C 2 and C c | . 

The impulse responses of the four types of frequency-selective ideal filters 
discussed above are summarized in Table 14.1 in terms of the normalized cut- 
off frequencies. It is observed that the impulse responses primarily include one 
or two sine functions and that all four types of ideal filters are non-causal. 


14.2 FIR and HR filters 


A second classification of digital filters is made on the length of their impulse 
response h[k]. The length (or width) of a digital filter is the number N of samples 
k beyond which the impulse response h [&] is zero in both directions along the 
A-axis. A filter of length N is also referred to as an /V-tap filter. 

A finite impulse response (FIR) filter is defined as a filter whose length N 
is finite. On the other hand, if the length N of the filter is infinite, the filter is 
called an infinite impulse response (HR) filter. Below, we provide examples of 
FIR and HR filters with length N specified in the parentheses. 



(a) (b) 


Fig. 14.5. (a) FIR filter; (b) HR 
filter. 


FIR filters 

Triangular sequence h[k] = 


\k\ 

1- — \k\ < 3 ,, 

3 1 1 - (N = 5); 

0 elsewhere 


shifted impulse sequence h[k] = 0.1<5[A: — 2] + <5[/c] + 0.2S[k — 2] 

(N = 5); 


exponentially decaying triangular sequence h [ k ] = E 0A lkl S[k — m \ 

m=—5 

(N = 11); 

10 000 1 

decaying impulses h[k] = &[k — m] (N = 10001). 

/n + l 

HR filters 


17=0 


Causal decaying exponential h[k\ = 0.6 k u[k] ( N = co); 

causal decaying sinusoidal h[k] = 0.5 k sin(0.2jtk)u[k] (N = oo). 

Other examples of HR filters include non-causal ideal filters as shown in 

Table 14.1. 

Figure 14.3(a) plots the triangular sequence with length N = 5 as an example 
of the FIR filter. Likewise, Fig. 14.3(b) plots the causal decaying exponential 
sequence with infinite length as an example of the HR filter. An important 
consequence of a finite-length impulse response h[k] is observed during the 
determination of the output response of an FIR filter resulting from a finite- 
length input sequence. Since the output response is obtained by the convolution 
of the impulse response and the input sequence, the output of an FIR filter is 
finite in length if the input sequence itself is finite in length. On the other hand, 
an HR filter produces an output response that is always infinite in length. 

A second consequence of the finite length of the FIR filters is observed in the 
stability characteristics of such filters. Recall that an LTID system with impulse 
response function h [7:] is BIBO stable if 

OO 

E IM*]I 

k =— oo 


< OO. 


Since the FIR filter is non-zero for only a limited number of samples k, the 
stability criterion is always satisfied by an FIR filter. As HR filters contain an 
infinite number of impulse functions, even if the amplitudes of the constituent 
impulse functions are finite, the summation ^ h [A' | in an HR filter may not be 
finite. In other words, it is not guaranteed that an HR filter will always be stable. 
Therefore, care should be taken when designing HR filters so that the filter is 
stable. 

The implementation cost, typically measured by the number of delay ele- 
ments used, is another important criterion in the design of filters. HR filters are 
implemented using a feedback loop, in which the number of delay elements is 
determined by the order of the HR filter. The number of delay elements used in 
FIR filters depends on its length, and so the implementation cost of such filters 
increases with the number of filter taps. An FIR filter with a large number of 
taps may therefore be computationally infeasible. 


14.3 Phase of a digital filter 


In Section 14.1, we introduced ideal frequency-selective filters as having rect- 
angular magnitude response with sharp transitions between the pass band and 
stop band. The phase of ideal filters is assumed to be zero at all frequencies. An 
ideal filter is physically unrealizable because of the sharp transitions between 
the pass bands and stop bands and also because of the zero phase. In this sec- 
tion, we illustrate the effect of the phase on the performance of digital filters. 
In particular, we show that distortionless transmission within the pass band can 
be achieved by using a filter having a linear phase within the pass band. 

Consider the following sinusoidal sequence: 

x[k ] — A\ cos(T?iA:) + A 2 cos(l? 2 &) + A 3 cos(l? 3 A:), 

consisting of three tone frequencies J?i < 1?2 < ( - h applied at the input of a 
physically realizable lowpass filter with the frequency response H( 17) illustrated 
in Fig. 14.4. The magnitude spectrum \H(f2)\ of the filter is shown by a solid 
line, while the phase spectrum <H(f2) is shown by a dashed line. The filter 
has a cut-off frequency i? c , such that 17 2 < I 2 C < C 3 , and the cut-off frequency 
lies within the transition band. Based on the frequency response H(fl) shown 


Fig. 14.4. Physically realizable 
lowpass filter with transition 
bands and non-zero phase. 



transition transition 

band band 


in Fig. 14.4, the magnitudes and phases of the transfer function at the tone 
frequencies are given by 

frequency 17 = ±l?i \H(fi)\ = 1, <//(l7) = =pm x ; 

frequency 12 = ±12 2 \H(fi)\ = 1, <//(12) = =Fm 2 l7 2 ; 

frequency 12 = ±123 \H(fi)\ = 0, <//(l7) = =pW3l?3; 

where m 1 , m2, and m3 are the slopes of the phase response at 17 = 12i , !2 2 and 

1?3, respectively. 

Using the convolution property, the DTFT of the output of the filter is given 
by 

7(12) = 12i)e imi " + 5(12- I2i)e" jmifi ] 

± A 2 tt [5(17 ± 12 2 )e i " ,2fi ± 5(12 - 12 2 )e“ jm2fi ] 

+ A 3 tt [5(12 + 12 3 ) + 5(12 - 12 3 )] • 0. 

Taking the inverse DTFT of the above equation, we obtain 

y[&] = A 1 cos(12i(A: — mi)) + A 2 cos(!2 2 (& — m 2 )). 

For m 1 ^ m 2 , the input tones Ai cos(12i/c) and A 2 cos(12 2 A:) are delayed une- 
qually and the output sequence y[k\ is a distorted version of the sinusoidal 
components present within the pass band of the filter. To retain the shape of the 
pass-band components, each sinusoidal term Ai cos(f2\k) and A 2 cos(12 2 A:) in 
v [At] should be delayed equally, i.e. mi = m 2 . In signal processing, the following 
two types of delays are defined: 

phase delay d p = — 0(12) / 12; 

, , , d<KO) 

roup delay d„ = ; 

B dfl 

where 0(12) is the phase of the filter transfer function, i.e. </>(&>) = / H (o>). 
In other words, the phase delay (d p ) is defined as the phase divided by the 
frequency, whereas the group delay (d s ) is defined as the derivative of the phase 
with respect to frequency. From the above definitions, it is observed that the 
delay of a filter will be constant if the phase 0(12) of the filter is a linear function 
of frequency. A filter is said to have a linear phase response if it satisfies the 
following relationships. 

0(12) = —a 12, or 0(12) = — 0:12 ± ft. 

The first condition ensures that the filter has constant phase and group delay, 
whereas the second condition ensures only constant group delay. Although it is 
desirable to have both constant group and phase delays, a constant group delay 
is generally sufficient in many applications. 

Based on the above discussion, the conditions for distortionless filtering, 
where the pass-band components are retained precisely at the filter output, are 
enlisted as follows. 


( 1 ) The pass-band gain of the filter should be the same for all frequency com- 
ponents present in the input signal that lie within the pass-band of the 
filter. 

(2) The phase <H(f2) of the filter should be linear for all input frequency 
components that lie within the pass band of the filter. 

(3) The stop-band gain of the filter should be zero within the stop band of the 
filter. 

Conditions ( 1 ) — (3) are valid for distortionless transmission within the pass bands 
of both FIR and HR filters and are checked by plotting the magnitude and phase 
spectra of the filters. For FIR filters, the linear phase condition (condition (2)) 
can also be checked directly from the impulse response h[k] as explained 
next. 


14.3.1 Linear-phase FIR filters 

Consider an FIR filter with impulse response h[k], which is non-zero within 
the range 0 < k < N — 1. The z-transform of the FIR filter is expressed as 
follows: 


N - 1 

H(z ) = h Wz~ k = h [0] + h[l]z~ l + /r[2] z“ 2 + ■ ■ • + h[N - 1] z _(Ar_1) . 

k = 0 

(14.7) 

The following proposition provides sufficient conditions for the phase linearity 
of an FIR filter. 

Proposition 14.1 If the impulse response function of an N-tap filter, with 
Z-transfer function given by Eq. (14.7), satisfies either of the following 
relationships: 

symmetrical impulse response h[k] = h[N — 1 — &]; (14.8a) 

antisymmetrical impulse response h[k] — — h[N — 1 — k], (14.8b) 

then the frequency response function can be represented as follows: 

H(fl) = G(t7)e i( ““ fi+W , (14.9) 

where G(t7) is a real-valued function of 12, a — (N — 1 )/2, and f is a constant 
that can be either zero orTt/2. Depending on the symmetry /anti-symmetry and 
even/odd length of h[k\, the FIR filters can be divided into four types: type 1, 
type 2, type 3 and type 4. Table 14.2 defines these four types of filters and the 
corresponding G(f2) and f values. It is observed that type 1 and type 2 filters 
have constant phase and group delays, whereas type 3 and type 4 filters only 
have constant group delay. 


Table 14.2. Linear-phase FIR filter types and the corresponding G(1 7) and p values 

The coefficients a[k] and b[k] in column 4 are defined as follows: o[0] = h[(N - l)/2], a[k] = 2 h[(N - 1)/ 

2 -k],b[k] = 2h[N/2-k] 


Type of FIR filter 

Length, N 

Symmetry 

G(O) 

P 

Type 1 

odd 

h[k] = h[N - 1 - k] 

(N-l)/2 

Y/ fl[7]cos(J7*) 

k- 0 

0 

Type 2 

even 

h[k ] = h[N - 1 - k] 

N/2 

^2 b[k] cos[l?(/: — 0.5)] 
*-1 

0 

Type 3 

odd 

h[k ] = -h[N - 1 -k] 

(AT— 1)/2 

Y a[7] sin(12A:) 

* — 1 

7t/2 

Type 4 

even 

77 

1 

1 

7= 

i 

II 

s 

N/2 

J2 b[k] sin[i7 (k - 0.5)] 

k= 1 

n/2 


Proof 

We prove Proposition 14.1 for a type 1 filters. The proof for type 2, type 3, and 
type 4 filters follows along the same lines. 

By substituting z = exp(jl7) in Eq. (14.7), we get 

7/(17) = MO] + h[l] e“ jj7 + • • • + h[N - 2] e ~^ N ~ 2 ^ + h[N - 1] e -j (A, - 1)fl . 


Taking exp(j(fV — 1)17/2) common from the left-hand side of the above equa- 
tion yields 

77(17) = e ~j (A, - 1)fi/2 [/;[0] e s(N-i)n/2 + e j(JV-3)n/2 

+ • • • + h[N - 2] e -j (A, - 3)fi / 2 + h[N - 1] e“ j(JV “ I)fl/2 ]. (14.10) 

We now pair the first term with the last term, the second term with the second 
last term, and so on for the remaining terms. Note that for a type 1 filter, N has an 
odd value and h[k] = h[N — 1 -k]. By pairing terms in Eq. (14.10), we obtain 


H(f2) = e-* N -V f2 / 2 [(h[0]e* N - 1 W 2 
+ (/;[!] e j(iV-3)fi/2 + h[N — 


( 

r a/ — i i 

h 

i 

V 

2 


+ h[N — l] e -j (A, - 1)fi/2 ) 
2]e _j(iv_3)J?/2 ) H 


r/v— i 1 

r 

„ +i 

e~ Jfi + h 

2 

/ L 


IV — IT 
2 


Because h[k] = h[N — 1 — k], the above equation reduces as follows: 


7/(17) = e -j (A, - 1)ft/2 
+ ••• + 2/1 


2 h [0] cos 
' N — 1 


(N - 1)17 


cos(17) + h 


2h[l] cos 
N — 1 


(N — 3)17 


= h 


N — 1 


(N- 3)/2 

2h[k] < 

k = 0 




N- 1 


— k 


Table 14.3. Examples of FIR filters with linear and non-linear phase 


Number 
of taps, N 

z-transfer function, H{z) 

Phase 

(linear or non-linear) 

Phase value 

4 

1 - 2 z” 1 + 2z" 2 - z“ 3 

type 4, linear 

— 1.512 + n/2 

3 

1 -z" 2 

type 3, linear 

—fi + n/2 

3 

1 + 2z _1 + 2z“ 2 

non-linear 


4 

1 + 2z _1 + 2z“ 2 + z — 3 

type 2, linear 

— 1.512 

4 

1 + 2z -1 - 2z“ 2 + z — 3 

non-linear 


5 

1 + 2z _1 + 3z -2 + 2z“ 3 + z -4 

type 1 , linear 

-212 

5 

1 + 2z _1 + 3z -2 + 2z“ 3 - z“ 4 

non-linear 



Substituting m = ' 11 — k in the above equation, we obtain 


H(Q) = e - jAr - 1)fl/2 | 


' N — 1 


2 


!* 

' N — 1 


2 

_ e -j(W-l)fi/2 

r (2V-l)/2 

E a[k 


(AT— 1)/2 

E 2h 

m - 1 
(N-l)/2 

- E 2h 

k= 1 


N - 1 
2 ' 

~N- 1 


cos(mi?) 

cos(&12) 




i=0 


where a[0] = /j[(2V — l)/2] and a[k] = 2h[(N — l)/2 — k]. It is observed that 
thederived H(f2) matches withEq. (14.9), wither — (N ~ l)/2 and G(l?) given 
in Table 14.2. 


Example 14.1 

Determine if the FIR filters specified in column 2 of Table 14.3 have linear 
phase or not. Also determine the value of the phase. 

Solution 

The phase linearity can be determined using the conditions given in Eq. (14.8). 
The third column of Table 14.3 shows whether a filter is linear phase and the 
type of linear-phase filter. The phase function, i.e. (— aft + fi) in Eq. (14.9), is 
shown in the fourth column. 

To confirm the results of the last two entries of Table 14.3, Fig. 14.5 plots 
the magnitude and phase spectra of the FIR filter specified in the second to last 
row of Table 14.3. The phase plot in Fig. 14.5(b) confirms that the FIR filter 
has a linear phase. Since a phase of : r is the same as that of — jr, the sharp 
transitions at 17 = ±0.5 jt are not discontinuities but correspond to the same 
value. The magnitude spectrum illustrates non-uniform gains within the pass 
band and stop bands, implying that the FIR filter is not an ideal lowpass filter 
despite having a linear phase. 


Fig. 14.5. Example of an FIR 
filter H(z) = 1+ 2 z~' + 

3 z~ 2 + 2 z~ 3 + z~ 4 with linear 
phase, (a) Magnitude spectrum; 
(b) phase spectrum. 




Fig. 14.6. Example of an FIR 
filter H(z) = 1 + 2z~' + 

3 z~ 2 + 2 z~ 3 - z~ 4 ) with 
non-linear phase, (a) Magnitude 
spectrum; (b) phase spectrum. 



Likewise, Fig. 14.6 plots the magnitude and phase spectra of the FIR filter 
specified in the last row of Table 14.3. The phase plot shown in Fig. 14.6(b) 
confirms that the FIR filter has a non-linear phase. 


14.4 Ideal versus non-ideal filters 


Table 14.1 shows the impulse response of four types of frequency-selective 
ideal filters. It is observed that the ideal impulse responses are non-zero for 
k < 0. Therefore, these ideal filters are non-causal and hence physically non- 
realizable. It is, however, possible to realize a non-causal filter by applying an 
appropriate delay. To elaborate, let us consider the transfer function of an ideal 
lowpass filter shown in Eq. (14.1a) in a slightly different form as follows: 


ffii P (J?) = 


g— j mf2 

o 


\n\ < q c 

Q c < \^\ 


(14.11) 


where a linear-phase component of exp(— is included within the pass 
band. The variable m is a constant that corresponds to the delay of the filter. 
The impulse response hn p [k] of the ideal lowpass filter is obtained by taking 
the inverse DTFT of Eq. (14.11), and is given by 


L ip I ] — 


sin ((k — m)f2 c ) 
( k — m)jt 


L?c 

— sine 
n 


( k — m)f2 c 


(14.12) 


Figure 14.7 plots the impulse response h\ v [k]. As illustrated in Fig. 14.7, the 
impulse response h\ v [k] of the ideal lowpass filter has an infinite length and is 
still non-causal. The ideal lowpass filter is therefore not physically realizable, 
irrespective of the value of delay m . Since the magnitude of the impulse response 
decays in both directions from its origin, k = m, a simple method to derive a 


Fig. 14.7. Impulse response of 
an ideal lowpass filter with a 
cut-off frequency of i? c and 
delay m. 


% AilpM 



causal implementation of the ideal lowpass filter is to truncate its impulse 
response on either side of its origin. We consider two such implementations: 

FIR implementation I 


hi[k] = 


<2 C 


TC 


( k — m)Q c 


jt 


0 


FIR implementation II 




hoik] = 


-sine 


7t 


(k — m)f2 c 


7T 


m — 70 < k < m + 70 
elsewhere; 


(14.13a) 


m — 10 < k < m + 10 
elsewhere. 


(14.13b) 


The length of the truncated FIR approximation is 141 in Eq. (14.13a) and 21 in 
Eq. (14.13b). The magnitude spectra for the two implementations are shown in 
Fig. 14.8. Compared with the ideal lowpass filter, we observe three significant 
changes in the causal implementations. 

(1) The gain within the pass band of the causal implementations is no 
longer constant but includes several oscillating ripples, referred to as the 
pass-band ripples. The distortion caused by the pass-band ripples is sig- 
nificantly higher when the truncated length is small. Compared with Eq. 
(14.13a) with a truncated length of 141, Eq. (14.13b) has a length of 21 
and results in a higher ripple distortion. 


Fig. 14.8. Magnitude spectrum 
of FI R implementations h i [Ar] 
and h 2 [k] obtained by 
truncating the impulse response 
hn p [k] of an ideal lowpass filter. 



Fig. 14.9. Specifications of a 
practical lowpass filter with three 
modifications from an ideal 
lowpass filter. First, a pass-band 
ripple of <5 P is included about the 
unity pass-band gain. Then a 
stop-band ripple of S s is 
included. Finally, a transition 
band of Q s - allows for 
smooth transition between the 
stop and pass bands. 





(2) Unlike the ideal lowpass filter, the FIR implementations have a significant 
transition band between the pass band and the stop band. The width of 
the transition band depends upon the length of the FIR implementations. 
The smaller the truncated length, the larger the width of the transition 
region. 

(3) The gain within the stop band of the causal implementations is no longer 
zero but contains ripples, referred to as the stop-band ripple. As in the pass 
band, the distortion produced by the stop-band ripples is higher when the 
truncated length is smaller. 

Since ideal filters are not physically realizable, a practical implementation of 
these filters is obtained by allowing acceptable variations in the magnitude 
response within the pass band and stop band. In addition, a transition band is 
included between the pass band and the stop band so that the magnitude response 
of the filter can drop off smoothly. Figure 14.9 specifies the magnitude response 
of a practical lowpass filter with the following characteristics: 

pass band (1 — 5 p ) < \H{H)\ < (1 + <5 p ) for \ fi\ < L? p ; 
transition band f2 p < \fl\ < L? s ; 

stopband 0 < \H(f2)\ < 8 S for L? s < \ fi\ < jr. 

The objective of a good design is to obtain a filter with limited ripples within 
the pass band and stop band, narrow transition bandwidth, and a linear phase 
at a reasonable implementation cost. Such an objective is self-contradictory. 
For example, a smaller transition band requires a relatively longer FIR filter or, 
alternatively, a higher-order HR filter. In the case of FIR filters, the complexity 
of the filter is directly proportional to its length. Keeping the transition band 
small therefore results in a higher cost. Likewise, for HR filters, the complexity 
depends upon the order of the filter. Increasing the order of the HR filter to 
reduce the transition bandwidth increases the implementation cost. The design 


Table 14.4. Impulse response of a 21 -tap FIR filter 


k 0,20 1,19 2,18 3,17 4,16 5,15 6,14 7,13 8,12 9,11 10 

h[k] -0.0014 0.0015 0.0066 0.0081 -0.0059 -0.0330 -0.0411 0.121 0.1320 0.2619 0.3183 


process generally involves some trade-offs between the desired characteristics 
of the specified digital filter. We will revisit this issue in Chapters 15 and 16, 
where we introduce several design techniques for the FIR and HR filters. 
Examples 14.2 and 14.3 consider the FIR and HR filters. 

Example 14.2 

Calculate the transfer function of a causal DT FIR filter whose impulse response 
h[k] is specified in Table 14.4. Determine and plot the magnitude spectrum of 
the FIR filter. What are the values of the stop-band ripple 8 S and the transition 
bandwidth? 


Fig. 14.10. FIR filter in Example 
14.2. (a) Impulse response h[k]; 
(b) magnitude spectrum 
\H(i2)\] (c) phase spectrum 

(d) magnitude spectrum 
\H(f2)\ in decibels. 


Solution 

The impulse response of the FIR filter is plotted in Fig. 14.10(a). To determine 
the frequency characteristics of the filter, we determine the z-transfer function 
of the FIR filter: 


20 

H(z) = ^h[k]z~ k . 


k = 0 



(a) (b) 



(c) 


(d) 


Substituting z = exp(jf7), the Fourier transfer function of the FIR filter is given 
by 

20 

H(H) = Y^h[k]e~ ikfi , 
k — 0 

which is used to plot the magnitude and phase spectra of the FIR filter in 
Figs. 14.10(b) and (c). It is observed that the gain of the filter is close to 
unity at low frequencies (17 0), while the gain is zero at high frequencies 

(17 rs it). Therefore, the impulse response h [T | represents a lowpass filter. Also, 
Fig. 14.10(c) illustrates that the phase of the FIR is piecewise linear. 

Without knowing the exact values of the pass and stop bands, it is difficult 
to determine the exact values of the stop-band ripple 8 2 and the transition 
bandwidth. An intelligent guess can be made by looking at the Bode plot of 
the FIR filter. Recall that the Bode plot is the same as the magnitude spectrum 
except that the magnitude of the filter is expressed in decibels (dB) as 

follows: 


gain in dB = 201og 10 (|//(l7)|). 

From the Bode plot shown in Fig. 14.10(d), we observe that the maximum value 
of | H(S 7)| within the stop band is approximately -52 dB. Expressed on a linear 
scale, the stop-band ripple 8 2 is given by 

8 S (dB) = 201og 10 (<5 2 ) = -52 =>• 8 S = lO” 26 = 0.0025. 

Figure 14.10(d) also provides approximate estimations of the pass band and 
stop band as follows: 

pass band (0 < |17 p | < 0.5) and stop band (1. 5 < |17 S | < tt). 

The transition band is therefore given by 0.5 < |17| < 1 .5. 


Example 14.3 

The transfer function of a DT HR filter is given by 


H(z) = 


0.12 z 

1.2z + 0.32’ 


Determine and sketch the impulse response h[k] of the filter. Determine and 
plot the magnitude response of the HR filter. 


Solution 

The characteristic equation of H(z ) is given by z 2 — 1.2 z + 0.32 = 0, which 
has two roots, at z — 0.8 and 0.4. The z-transfer function H (z) can therefore 
be expressed as follows: 

H(z) 0.12 _ k x k 2 

~T ~ z 2 - 1.2z + 0.32 = z — 0.8 + z-0.4' 


-K 


-0.5k 
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Fig. 14.11. HR filter in Example 
14.3. (a) Impulse response h[k]; 
(b) magnitude spectrum 
|W(12)|; (c) phase spectrum 
<H(k2): (d) magnitude spectrum 
\H(f2)\ in decibels. 


Using Heaviside’s partial fraction formula the coefficients of the partial fractions 
k\ and kz are given by 


k] = 


(z - 0.8)- 


0.12 


' 0.12 ' 

0.8)(z — 0.4) _ 

z=0.8 

O 

1 

K? 


= 0.3 


J 2 = 0.8 


and 


&2 


( z 


0.4) 


0.12 


' 0.12 ' 

(z — 0.8)(z — 0.4) _ 

2=0.4 

1 

0 

bo 

1 


-0.3. 


The partial fraction expansion of H(z) is therefore given by 


H(z) = 


0.3z 

z-0.8 + 


— 0.3z 
z — 0.4 


Taking the inverse z-transform of H(z ) yields 


h[k] = 0.3[(0.8)* - (0.4)*]m[*]. 


which is plotted in Fig. 14.1 1(a). Note that the HR filter has infinite length, as 
expected. 

The Fourier transfer function of the HR filter is obtained by substituting 
Z = exp(jl7): 

0.12e“j fi 

( * “ 1 - 1.2e-i« + 0.32e-i M ' 

The magnitude spectrum of the HR filter is plotted in Figs. 14.11(b) and (d). 
Since the gain of the filter is unity at low frequencies (around Q ~ 0) and 
close to zero at high frequencies (around 1? « n), the impulse response li[k] 


represents a lowpass filter. Figure 14.1 1(c) illustrates that the phase of the HR 
filter is non-linear; therefore, the HR filter introduces distortion within the pass 
band. 


14.5 Filter realization 


In the preceding chapters, we presented several different techniques to calculate 
the output of a DT system. In the time domain, the output response y[k] can be 
determined from its input x [A:] either by solving a linear, constant-coefficient, 
difference equation of the following form: 

a 0 y[k] + a\y[k - 1] H h a N y[k - N] 

= box[k] + b\x[k — 1] + • • ■ + bMx[k — M] 

or, alternatively, by calculating the convolution sum between the input x [k] and 
the impulse response h [A:] . The convolution sum is given by 

OO 

y[k] = x\k] * h[k] = x[m]h[k — m]. 

m=—o o 


In the frequency domain, the convolution property is used to express the con- 
volution sum in terms of the transfer function H (fl) and the CTFT X(fJ) of the 
input as follows: 


x[k] ► ! z~ l | ► x[k - 1 ] 

(a) 



(c) 


Fig. 14.12. Fundamental 
elements for building digital 
implementations for FIR and HR 
filters, (a) Unit delay element; 
(b) adder; (c) constant- 
coefficient multiplier. 


F(f?) = X(n)H{f2), 

from which the output y [A:] can be determined by calculating the inverse CTFT 
of T(f2). On digital computers and specialized DSP boards, the output of a dig- 
ital filter is generally obtained by iteratively evaluating the recurrence formula, 
1 

y[k] = (+aiy[k — 1] H 1- a N y\k - At]) 

a 0 

1 

H (b 0 x[k] + b\x[k — 1] + 1- b M x[k — M]), 

ao 


derived from the difference equation. Implementing the recurrence formula 
requires delaying the samples of the input and output sequences, multiplying 
the sample values with constant coefficients, and adding the resulting prod- 
ucts. In other words, we require three mathematical operations, shift or delay, 
multiplication, and addition, to solve a difference equation iteratively. In the fol- 
lowing, we introduce the schematic representation of these three fundamental 
operations. 


14.5.1 Shift or delay operator 

On digital computers and specialized DSP boards, the shift operation is 
implemented using a cascaded combination of delay elements. The schematic 


representation of a unit delay element is illustrated in Fig. 14.12(a), where the 
transfer function of the block is given by H(z) = z _1 . The impulse response 
h[k ] of the unit delay element is given by h\k\ = S[k - 1 ]. The output is there- 
fore given by x [£] * 8 [k — 1] = x[k — 1]. If a delay of more than one sample 
is required, several unit delay elements may be cascaded together in a series 
configuration. 


14.5.2 Adder 


On digital devices, adders are typically implemented using combinational or 
sequential circuits consisting of registers and logic gates. The schematic repre- 
sentation of an adder is illustrated in Fig. 14.12(b), where the input sequences 
X\[k] and X2 [fc] produce an output x\[k] + X 2 [k}. 


14.5.3 Multiplication by a constant 

On digital devices, multipliers are typically implemented using sequential cir- 
cuits consisting of registers, shift delays, and logic gates. The schematic rep- 
resentation of a constant multiplier is shown in Fig. 14.12(c), where the input 
sequence x[k ] is multiplied with a constant a, producing an output ax[k]. 

In the following sections, we sketch signal flow graphs for efficient implemen- 
tations of both FIR and HR digital filters using the aforementioned elements, 
referred to as the fundamental elements. By manipulating the signal flow graphs, 
we present several different but equivalent structures for the same transfer func- 
tion. We also demonstrate the effect of finite-precision arithmetic on the gain- 
frequency characteristics of digital filters, and provide several design tips to 
alleviate the problems arising from finite-precision arithmetic. 


14.6 FIR filters 


A causal FIR filter, of finite length N and having non-zero values in the range 
0 < k < (N — 1), is represented by the following transfer function: 

N - 1 

H(z ) = J2 h ^ z ~ k = /j [°] + M!]* -1 + h[2]z~ 2 + • • • + h[N - l]z“ (Ar “ n 

k = 0 

(14.14) 

or, alternatively by a difference equation obtained by solving the convolution 
sum: 

iV-l 

y[k] = £ h[k]x[k — m] 

m= 0 

= h[0]x[k] + h[\]x[k - 1] + • • ■ + h[N - 1 ]x[k - (N - 1)]. (14.15) 


Fig. 14.13. Direct form for 
causal FIR filters of length N . 


<N 



There are several flow graph representations of the FIR filter. In the following, 
we discuss some of them. 


14.6.1 Direct form 


The flow graph for direct form is achieved by implementing Eq. (14.15) directly. 
In direct form, the constant multipliers are the same as the coefficients of the 
difference equation, Eq. (14. 15). The direct form of the flow graph for a causal 
FIR filter is shown in Fig. 14.13. Since the cost of implementation of a filter is 
directly proportional to the number of fundamental elements used, we include 
a count of these elements for each flow graph. The number of the fundamental 
elements used in Fig. 14.13 is shown in the second row of Table 14.5. 

The flow graph for the direct form resembles a tapped delay line used fre- 
quently in communication systems for channel equalization. The filter shown 
in Fig. 14.13 is therefore referred to as a tapped delay line filter or sometimes 
as a transversal filter. 


14.6.2 Cascaded form 


The flow graph for the cascaded form is achieved by expressing Eq. (14.14) in 
terms of a product of quadratic terms: 

m 

H(z) = h[ 0] n (! + *1 nZ~ l + b ln z~ 2 ). (14.16) 

n=l 

Factorizing H (z) in terms of quadratic terms ensures coefficients b i„ and bin 
to be real- valued provided that the impulse response h[k\ is also real-valued. 
Had linear factors been considered in Eq. (14.16) there would be no guarantee 
for the coefficients of the linear factors to be real-valued, even with real-valued 
h[k]. The upper limit [(N — l)/2] in the summation in Eq. (14.16) represents 
a ceiling operation, which equals (N — I )/2 if N is odd. If N is even, the upper 
limit equals N /2 with b^,, = 0 for the last product term. 

The flow graph of the cascaded form is achieved by considering [(N — I )/2"| 
substructures and cascading the substructures together in a series configuration. 
The resulting flow graph is shown in Fig. 14.14. The number of fundamental 
elements used in Fig. 14.14 is shown in the third row of Table 14.5. 


Table 14.5. Number of elements required to implement different types 
of FIR filter structures 


Structure 

two-input address 

Unit delays 

Constant multipliers 

Direct form 

N - 

1 

N - 

1 

N 

Cascaded form 

N - 

1 

N — 

1 

N 

Linear phase 

N - 

1 

N - 

1 

N/2 (N even) 

filters 





(N + l)/2 (N odd) 


Fig. 14.14. Cascaded form for 
causal FIR filters of length N . 



14.6.3 Linear-phase FIR filters 

As proved in Proposition 14.1, an A' -tap linear phase FIR filter satisfies the 
following symmetry condition: 

h[k] =h[N- 1 -k] or h[k] = -h[N - 1 - k]. 


For the symmetry condition h[k] — h[N — 1 — k], we show that the condition 
can be used to reduce the number of constant multipliers. The derivation for the 
antisymmetry condition, h[k) — —h[N — 1 — k], follows along similar lines. 
If the length N of the filter is even, Eq. (14.14) is rearranged as follows: 


H(z) = /i[0](l + z^” 1 *) + /?[l](z _1 + z" (iv " 2) ) 


*-l 

2 


-(iV/2-l) 


+ z- W2) ). 


On the other hand, if the length N of the filter is odd, Eq. (14.14) is rearranged 
as follows: 


H(z) = /;[0](1 + z- (JV - 1} ) + h[\](z~ l + z" (iV - 2) ) 
' N — 1 


h 


' n — r 


i 


_-«jV-l)/2-l) + ,-((JV-l)/2+l)\ 


t _(AT_1)/2 


Using the above equations, the flow graphs of the linear-phase FIR filter satis- 
fying the symmetry condition is shown in Fig. 14.15. Both even and odd values 
of length N are considered. The numbers of fundamental elements required are 
shown in the fourth row of Table 14.5. It is observed that the number of constant 


x[k] 


Fig. 14.15. Flow graphs for 
linear-phase FIR filters. 

(a) Length N is odd; (b) length 
N is even. 


>#] 



N - 1 
2 


(a) 



(b) 


multipliers is roughly half that required in direct form or cascaded form. The 
number of unit delay and addition elements, however, stays the same. 


14.6.4 Transposed forms 

Alternative flow graphs for implementations in Sections 14.6.1-14.6.3 can be 
realized by applying the transpose operation. Transposition of a flow graph 
is achieved by (i) interchanging the role of the input and output; (ii) revers- 
ing the directions of all branches within a flow graph; and (iii) replacing the 
source nodes by adders, and vice versa. Note that the number of fundamental 
elements required to implement a filter does not change if the transposed form 
is used for implementation. We explain the principle of transposition with an 
example. 

Example 14.4 

Implement direct form and cascaded configurations of the flow graph for the 
FIR filter with transfer function given by 

H(z) = -0.3 - 0.4z _1 + 1.4z" 2 - 0.4z“ 3 - 0.8z“ 4 . 




(a) 


(b) 


Fig. 14.16. (a) Direct form I and Using transposition, derive an alternative configuration from the cascaded 
(b) cascaded configurations for implementation, 
the FIR filter in Example 14.4. 

Solution 

The flow graph for the direct form is shown in Fig. 14.16(a). For the cascaded 
configuration, we factorize H(z) as follows: 

H(z) = —0.3 (1 + 2.9595z _1 )(l + 0.6038z _1 )(l - (1.1150 - j0.4992)z“ 1 ) 
x(l - (1.1150 +j0.0.4992)z- 1 ). 

Expressing H(z ) as a product of quadratic terms, we obtain 

H(z) = -0.3(1 + 3.5633z _1 + 1.7868z“ 2 )(l - 2.23z _1 + 1.4924z“ 2 ), 


Fig. 14.17. Transpose 
configurations of flow graph in 
Fig. 14.16(b). 


which has the flow graph illustrated in Fig. 14.16(b). 

The alternative configuration for the cascaded form, obtained by applying 
the transposition principle, is shown in Fig. 14.17 using two steps. Step 1 
interchanges the role of the input and output, reverses the directions of all 
branches, and replaces the source nodes with adders. Similarly, the adders are 
replaced by source nodes. The resulting configuration is shown in Fig. 14.17(a), 
where the input is on the right-hand side of the flow graph and the output is on 
the left-hand side. Figure 14.17(b) is a reordered version of Fig. 14.17(a) with 
the input and output, rearranged to the standard right-hand and left-hand sides, 
respectively. 



(a) 


(b) 


Table 14.6. Number of elements required to implement different types of HR filter 
structures 

M and N are, respectively, the degree of the numerator and denominator 
polynomials in H(z), as shown in Eq. (14.17) 


Structure 

Unit delays 

Two-input adders 

Constant multipliers 

Direct form I 

M + N 

M + N 

M + N + 1 

Direct form II 

max(M, N) 

M + N 

M + N + 1 

Cascaded form 

max(M, N) 

M + N 

M + N + 1 

Parallel form 

max(M, N) 

M + N (M > N) 
2 N (M < N) 

M + N + 1 (M > N) 
2N + 1 (M < N) 


Finally, it should be noted that H(z ) does not represent a linear-phase FIR 
filter. As such, the linear-phase configuration cannot be derived for this filter. 

The direct form and cascaded implementations of the FIR filters can be extended 
to the HR filters, which are discussed in Section 14.7. 


14.7 HR filters 


The transfer function of an HR filter is given by 

bo + b\z~ l H h b M z~ M 


H(z) = 


1 + CI\Z + • ■ ■ + QnZ 


-N 


(14.17) 


where the coefficient ao of the constant term in the denominator is normalized 
to one. Based on Eq. (14.17), an HR filter can alternatively be modeled by the 
linear, constant-coefficient difference equation given by 


y[k] + a x y[k — 1] H b a N y[k - N] 

= b 0 x[k] + b x x[k — !] + ••• + b M x[k - M], (14.18) 


There are four major architectures to implement the HR filters, which are con- 
sidered in the following. 


14.7.1 Direct form I 


To derive the HR realization of the transfer function, Eq. ( 14.17), we implement 
the numerator and denominator functions, defined as follows: 

numerator N(z) = bo + Tqz -1 H + b M z~ M \ 

denominator D(z) = 1 + cqz -1 + • • • + a^z ~ N , 

separately. The resulting flow graph is shown in Fig. 14.18, where the first 
structure represents N (z) and the second structure represents D(z). The numbers 
of fundamental elements required in direct form I are shown in the second row 
of Table 14.6. 


Fig. 14.18. Direct form I for HR 
filters where numerator 
polynomial N (z) and 
denominator polynomial D (z) 
are implemented as cascaded 
systems. The degree M of the 
numerator is assumed to the 
same as the degree N of the 
denominator. 



Fig. 14.19. Direct form I 
realization for the HR filter in 
Example 14.5. 


x[k] 



Example 14.5 

Implement the direct form I realization of an HR filter with the following transfer 
function: 


H{z) = 


z 3 -2 z 2 + z 

z 3 - O.lz 2 - 0.07z - 0.065' 


(14.19) 


Solution 

The transfer function H(z) can be represented as follows: 


H(z) = 


1 - 2z~ x 


„-2 


1 - O.lz" 1 - 0.07z -2 - 0.065z -3 ’ 
with the difference equation given by 


y[k] = x[k] - 2 x[k - 1] + x[k - 2] - {-0.1 y[k - 1] 
- 0.07y[k - 2] - 0.065y[it - 3]} 

= x[k]-2x[k- l]+x[k-2] + 0.ly[k- 1] 

+ 0.07 y[k - 2] + 0.065v[^ - 3]. 


The flow graph using direct form I is illustrated in Fig. 14.19. 



















(a) 


(b) 


Fig. 14.20. Direct form II for HR 
filters where degrees of the 
numerator (M) and 
denominator ( N ) are assumed 
to be the same. 


14.7.2 Direct form II 


Direct form II is realized by noting that the order of structures N(z ) and D(z) can 
be interchanged as for any two systems in a series combination. The resulting 
flow graph is shown in Fig. 14.20(a). Since nodes a and a' have the same 
polarity, these nodes can be merged by replacing the top two delay elements 
by one delay element. Similarly, nodes fi and ft' can be merged, and so on for 
the rest of the adjacent nodes below the delays in structures I)(z) and N(z). 
The resulting flow diagram is referred to as direct form II and is illustrated in 
Fig. 14.20(b). The number of fundamental elements required in direct form II 
is shown in the third row of Table 14.6. 

A flow graph that requires the minimum number of delay elements, multi- 
pliers, and adders to implement a filter is referred to as a canonical structure. 
It can be shown that the implementation complexity of an arbitrary HR filter 
with a numerator of degree M and a denominator of degree N cannot be less 
than the complexity of the flow graph for direct form II shown in Fig. 14.20(b). 
Therefore, direct form II with the flow graph shown in Fig. 14.20(b), is a canon- 
ical architecture. On the other hand, direct form II with the flow graph shown 
in Fig. 14.20(a) is a non-canonical architecture. 







Fig. 14.21. Direct form II 
architecture for the HR filter in 
Example 14.6. 


m -►(+} 


>-►(+) ► 



Example 14.6 

Implement the filter in Example 14.5 using the direct form II realization. 


Solution 

The flow graph for direct form II realization is shown in Fig. 14.21. 


14.7.3 Cascaded form 


The flow graph for the cascaded form is achieved by expressing the numerator 
and denominator polynomials in Eq. (14.17) in terms of a product of quadratic 
terms: 


Fig. 14.22. Cascaded form 
architecture for HR filters. 


"[ (1 + blmZ 1 + b 2m z 2 ) 

H(z) = b 0 ^~ . (14.20) 

I 2 I 

”[ (1 +a ln z~ 1 +a 2n Z ~ 2 ) 

n = 1 

Factorizing H(z ) in terms of quadratic terms ensures coefficients b\ n and b 2n 
to be real-valued provided that the impulse response h [£] is also real- valued. 



x[k] 


► y[k] 








Fig. 14.23. Cascaded form 
architecture for the HR filter in 
Example 14.7. 


In general, the quadratic terms may be coupled together in the following 
form: 


_ , (1 +b u z 1 +b 2 iz 2 ) (1 + b n z 1 + b 2 2 Z 2 ) 

°(1 +a n z~ x +a 2i z~ 2 ) X (1 +ai 2 Z _1 + a 22 z~ 2 ) 


(1 + aiqZ 1 + a 2q z l ) 


(14.21) 


where q = min(|"At/2], |"(M/2]), and Q(z ) represents the uncoupled terms 
arising from unequal values of degree N and M. The first q quadratic terms in 
Eq. (14.21) are implemented using a cascaded configuration of the direct form 
II realization, while Q(z) may be implemented in either direct form I or direct 
form II realization. The flow graph for Eq. (14.21) is shown in Fig. 14.22. The 
numbers of fundamental elements required in cascaded form are shown in the 
fourth row of Table 14.6. 


Example 14.7 

Implement the filter in Example 14.5 using the cascaded form. 


Solution 

The transfer function H(z) is expressed as follows: 


H(z) = 


l-2z~ l +z~ 2 

1 - O.ltr 1 - 0.07 z~ 2 - 0.065z -3 


(1 ~ z -1 )(l ~ z -1 ) 

(1 — 0.5z-*)[l -(-0.2+j0.3)z- 1 ](l — (— 0.2 — j0.3)z- 1 ] ' 


Note that if the filter is implemented using only first-order filters, the filter 
coefficients will be complex. In order to avoid complex values for the filter 
coefficients, the complex roots are combined into a quadratic term as follows: 


H(z) = 


1 


2 z~ l +z~ 2 


1 +0.4Z- 1 +0.13z 


-2 


1 

1 + 0.5r 


-i ' 


(14.22) 


The flow diagram for Eq. (14.22) is shown in Fig. 14.23, where we have omitted 
scalar multiplications where the multiplier is unity. 


Table 14.7. Comparison of the number of fundamental elements in flow graphs 
obtained from different forms for the MR filter implemented in Examples 14.4-14.7 


Form 


Number of 


unit delays 

scalar multipliers 

dual-input adders 

Direct form I 

5 

4 

5 

Direct form II 

3 

4 

5 

Cascaded form 

3 

4 

5 

Parallel form 

3 

6 

5 


14.7.4 Parallel form 


In this form, HR filters are implemented as a parallel combination of first- and/or 
second-order filters. To derive the parallel realization, the transfer function H(z) 
is expressed in terms of its partial fractions: 


H(z) = Q(z) + - — 

1 - pit 


ki 

1 - PlZ~ l 


k N 

1 - PnZ~ 1 ’ 


(14.23) 


where k\ , & 2 , . . . , k^ are partial fraction coefficients, obtained from Heaviside’s 
formula, and pi, pi, ■ ■ ■ , Pn are the poles of 7/(z). To prevent complex-valued 
coefficients, Eq. (14.23) is expressed in terms of quadratic terms as follows: 


H(z ) = Q(z) + 


N+l 
. 2 . 

£ 


bln + l>2nZ 1 

1 + ai„Z -1 + fl2nZ _2 


(14.24) 


If the degree N of the denominator in H{z) is odd, d 2 „ = 7>2n = 0 (for n = 
f /V /2~| ). The parallel form of the HR filter is illustrated in Fig. 14.24. The 
number of fundamental elements required in the parallel form are shown in 
the fifth row of Table 14.6. Note that the parallel architecture has the same 
complexity as the direct form II and cascade architectures when N = M. If the 
numerator and the denominator are not of the same degree, a larger number of 
scalar multipliers and two-input adders are required. 


Example 14.8 

Implement the HR filter in Example 14.5 using the parallel form. 


Solution 

Using partial fraction expansion, the transfer function H(z) is expressed as 
follows: 


H(z) = 


k\ 

1 -0.5z -1 


kll + k22Z 1 
1 +0.4z -1 + 0.13z -2 ’ 


where the partial fraction coefficients are determined as k\ — 0.431, &21 = 
0.569, and £22 = —1.8879. Figure 14.25 shows the parallel form of the HR 
filter. 


Fig. 14.24. Parallel form 
architecture for HR filters. 




Fig. 14.25. Parallel form 
architecture for the HR filter in 
Example 14.8. 


4k] 



+ y\k] 


In Table 14.7, we compare the different realizations of the HR filter specified in 
Example 14.5. Trivial scalar multiplications, where the scalar multiplier is unity, 
are ignored. The cascaded form yields the minimum number of fundamental 
elements used. This, however, is valid only for Example 14.5 and is not true in 
general. 


14.7.5 Transposed forms 

As was the case for FIR filters, alternative flow graphs for the implementations 
in Sections 14.7.1-14.7.4 can be realized by applying the transpose operation. 













14.7.6 Choice of structures 


The direct form II, cascaded and parallel forms are referred to as canonical 
structures and have roughly the same implementation complexity. The actual 
complexity of each form of realization depends on the transfer function under 
consideration. Table 14.7 compares the four structures in terms of the number 
of unit delays, scalar multipliers, and dual-input adders for the filter consid- 
ered in Examples 14.4-14.7. It is observed that the direct form I requires the 
largest number of delay elements. The direct form II, cascaded, and parallel 
structures require an identical number of delay elements and adders. However, 
the cascaded form needs to implement the lowest number of multipliers. This 
is because there are two multipliers that perform multiplication by a factor of 
one. These unity multipliers need not be implemented. The parallel structure 
requires the largest number of multipliers. 

Irrespective of the arithmetic complexity, all of these realizations should 
provide identical outputs for the same input. As we shall see in the following 
section, the filter coefficients are implemented using finite precision. The impact 
of finite-precision arithmetic on the performance of digital filters is the focus of 
our discussion in Section 14.8. The following are some empirical observations 
that should be kept in mind when choosing a particular realization. 

(i) When the poles of the transfer function lie close to each other or close to 
the unit circle in the complex z-plane, direct form realizations, with filter 
coefficients represented using finite precision, produce large deviations 
from the output of an exact filter. 

(ii) The order in which the first- and second-order systems are implemented 
in cascaded forms affects the output of the filter in finite-precision imple- 
mentations. Changing the order may reduce the deviation from the output 
of an exact filter. 

(iii) Pairing of complex poles and zeros is important for all cascaded and 
parallel realizations. 

(iv) In cascaded realizations, scalar multipliers between different systems may 
be required to prevent the partial fraction coefficients from becoming too 
large or too small. 


14.8 Finite precision effect 


Figure 14.26 illustrates the processing of analog signals with digital systems. 
The analog signal y(t ) produced by such a system contains distortions from 
several sources, including 

(i) analog-to-digital conversion (ADC) noise; 

(ii) finite-precision approximation of filter coefficients; 


x(t) 



►xo 


Fig. 14.26. Processing of analog 
signals with digital filters 


(iii) round-off errors; 

(iv) register overflow. 


These effects are considered in the following. 


14.8.1 Analog-to-digital conversion (ADC) noise 

The process of encoding the analog signal x(t) into a DT signal x[k], quantized 
to a fixed number of bits, involves discarding the higher resolution information 
of the analog signal. The resulting distortion is referred to as the analog-to- 
digital (ADC) noise. The amount of ADC noise is inversely proportional to the 
number of bits used in the quantization process. For example, assume that the 
true value of a sample is given by 0.875 364 573 894 562 234 5. If the sample 
is quantized by a 3 -bit uniform quantizer with a peak-to-peak range of ±1 V, 
the sample value would be quantized to 0.9375, leading to an ADC noise of 
—0.062 135 426 105 44. If instead an 8-bit uniform quantizer is used, the sample 
value would be approximated to 0.878 906 25 with an ADC noise of —0.003 
541 676 105 44. The ADC noise can, therefore, be reduced by using a higher- 
resolution quantizer with a larger number of reconstruction levels, but it can 
never be eliminated. The ADC noise causes the analog signal y(t), recovered 
from the processed digital sequence y[k], to deviate from the output signal 
produced by a completely analog system, which is equivalent to the schematic 
representation of Fig. 14.26. 

A second error introduced by the quantizer is referred to as the saturation 
noise, which occurs when the input signal x(t ) exceeds the peak-to-peak operat- 
ing range for which the quantizer is designed. Since the range of the saturation 
noise is unlimited, the saturation noise is more objectionable than the ADC 
noise. 


14.8.2 Finite-precision approximation of filter coefficients 

The filter coefficients designed from a given specification are analog and have 
infinite precision. When the filter coefficients are represented using a finite 
number of bits, quantization noise is introduced. As a result, the characteristics 
of the digital filter may change considerably from the design specifications. 

A common standard used for representing floating point numbers on a digital 
computer is the IEEE 754 floating point standard, which uses 32 bits in the 
single-precision mode. The representation for the 32-bit IEEE standard is shown 






Table 14.8. Representation used in the 32-bit IEEE 754 floating point single-precision standard 


31 

30 

29 

28 

27 

26 

25 

24 

23 
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20 
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18 

17 

16 

15 

14 

13 

12 

11 

10 

9 

8 

7 

6 

5 

4 

3 

2 

1 

0 

5 

(Ibit) 

exponent 
(8 bits) 

significand 
(23 bits) 


Table 14.9. IEEE 754 floating point representation for the decimal number for -0.75 ten 
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in Table 14.8, where a single-precision, floating point number in IEEE 754 
standard is represented in scientific notation as follows: 

(-1) 1 x (1 + O.significand) x 2 (ex P onent - 127) . (14.25) 

Note that the s-bit represents the sign of the floating point. The .v-bit is set to 
unity for negative numbers and to zero for positive numbers. The significand 
specifies the decimal fraction, while the exponent represents the power in terms 
of 2. As an example, consider the IEEE 754 binary representation of the decimal 
number —0.75, represented by — 0.75 ten - The binary representation of — 0.75 te n 
is given by 

— 0.75 ten = — 0. 1 l two , 

which in scientific notation is represented by 

— 0.75 ten = 1 - ltwo x 2 -1 . 

Comparing with Eq. (14.25), the values of the exponent and significand are 
given by 

O.significand = 0. l t wo and exponent = 126 or OllllllOtwo- 

The single-precision representation for — 0.75 ten is specified in Table 14.9. 

To derive the resolution of the 32-bit single-precision arithmetic, we calculate 
the two smallest numbers that can be represented by Eq. (14.25). The smallest 
number is given by 

(-1) 1 x (1+0.111 111 lit*,,) x 2~ 127 

= -1 x 1.99609375 x 2” 127 = -1.173 198463418338 x 10" 38 . 

The next smallest number represented by the 32-bit single-precision arithmetic 
is 

(— l) 1 x (1 -E 0.11 1 111 lOtwo) X 2~ nl 
= -1 x 1.992 187 50 x 2" 127 = -1.170902576 014388 x 10“ 38 . 


The resolution of the 32-bit single-precision arithmetic is therefore the differ- 
ence of these numbers: 

-1.173 198 463 418 338 x 10“ 38 - (-1.170902576014388 x 10~ 38 ) 

= -2.295 887 403 950 041 x 10~ 41 . 

If the hardware allows for IEEE 754 single precision, then the quantization error 
is proportional to —2.295 887 403 950041 x 10~ 41 . Generally, specialized DSP 
boards are restricted to a smaller number of bits than the IEEE 32-bit single- 
precision representation. 

The addition of quantization noise into the filter is a non-linear process. The 
detailed analysis of the effect of the quantization noise on the performance 
of the filter is beyond the scope of this text. In the following, Example 14.9 
illustrates the effect of finite-precision arithmetic on the magnitude response of 
a 21 -tap FIR filter. 


14.8.3 Round-off errors 

Because of the limited resolution of DSP boards, the output response of a filter 
cannot be accurately represented. In the 32-bit signed IEEE 754 floating point 
standard, the resolution of each sample of the output response is restricted 
to 2.295 887 403 950 041 x 1 0 4 1 . The distortion due to rounding off sample 
values to the resolution allowed by the DSP board is less damaging than the 
finite-precision representation of the filter coefficients. In the latter case, the 
distortion is substantially magnified. Still, the round-off errors in the sample 
values should be considered in the analysis of a filter performance. 


14.8.4 Arithmetic overflow 

Arithmetic overflow occurs during multiplication, division, or addition, when 
the final answer falls outside the range of the DSP board. For example, the 
dynamic range of the 32-bit signed IEEE 754 floating point standard is restricted 
to a maximum value of 2. 0 ten x 10 38 and a minimum value of —2. 0 ten x 10 38 . If 
the result of any mathematical operation between the two floating point numbers 
falls outside this range, then an overflow occurs. 

Example 14.9 

Consider the 21 -tap FIR filter with impulse response as shown in Table 14.10, 
where each coefficient is represented by 14 decimal digits. The FIR filter is 
implemented on a DSP board, which uses finite-precision arithmetic given by 

(— l) s x (0 + O.significand), 

where the significand represents the decimal fraction of the number and is 
limited to a fixed number of bits. There are no bits allocated for the exponent. 


Table 14.10. Finite impulse response 
h[k] of the 21 -tap FIR filter specified in 
Example 14.9 


k 

h[k] 

10 

0.318 348 783 765 15 

9,11 

0.261 850185 125 51 

8,12 

0.132021415468 16 

7,13 

0.012 135 562 15039 

6,14 

-0.041086983 05248 

5,15 

-0.032 969 416 668 68 

4,16 

-0.005 898 263 64095 

3,17 

0.008 055 858 168 72 

2,18 

0.006608 361295 03 

1,19 

0.001494 396 943 68 

0, 20 

-0.001 385 507 67195 


Table 14.11. Impulse response of the FIR filter in Example 14.9 with 4-bit and 8-bit finite precisions 

k 

Exact 


h\k] 


8-bit binary representation 

4-bit precision 

8-bit precision 

10 

0.318 348 783 765 15 

0.01010001 

0.3125 

0.316406 25 

9, 11 

0.261 850185 125 51 

0.010000 11 

0.25 

0.26171875 

8, 12 

0.132021415468 16 

0.00100001 

0.125 

0.128 90625 

7, 13 

0.012 135 562 150 39 

0.000000 11 

0 

0.01171875 

6, 14 

-0.041086 983 052 48 

-0.000010 10 

0 

-0.039 062 5 

5, 15 

-0.032969416668 68 

-0.00001000 

0 

-0.03125 

4, 16 

-0.005 898 263 64095 

-0.00000001 

0 

-0.003 90625 

3, 17 

0.008 055 858 168 72 

0.000000 10 

0 

0.007 812 5 

2, 18 

0.006 608 361295 03 

0.00000001 

0 

0.003 90625 

1, 19 

0.001494 396 943 68 

0.00000000 

0 

0 

0, 20 

-0.001 385 507 67195 

0.00000000 

0 

0 


Calculate the filter coefficients with the significand restricted to a total of 7 bits 
and where 1 bit is allocated for the sign. Plot the magnitude response of the 
filter. Repeat for a 3-bit significand with 1 bit allocated for the sign. 


Solution 

The filter coefficients with the 4-bit and 8-bit finite-precision arithmetic are 
shown in Table 14.11. We illustrate how we derived the result for the filter 
coefficient h[ 10] = 0.318 348 783 765 15. The remaining entries can be derived 
by following the procedure specified for /z[10]. 


Fig. 14.27. Frequency 
characteristics of the filter with 
quantized coefficients in 
Example 14.9. 



The binary representation for /z [ 1 0] = 0.318 348 783 765 15 is given by 

0.31 8348783765 15 ten = 0.010 100010 11 1 111 1 . . ., w0 . 

For 4-bit precision, the finite-precision representation of /? [ 1 0] is given by 

(-1)° x (0 + 0.010 lW = 2 -2 + 2 -4 = 0.3125. 

For 8-bit precision, the finite-precision representation of /? [ 1 0] is given by 

(-1)° x (0 + 0.010 100 01) two = 2" 2 + 2' 4 + 2“ 8 = 0.31640625. 

In deriving the above values, the finite-precision representations are truncated to 
the available number of bits. Alternatively, the numerical values can be rounded 
off to the nearest available level in each representation. The latter reduces the 
quantization noise. 

In Table 14.7, we observe that several filter coefficients are reduced to zero. 
With 8-bit precision, the values of h [0] , h [ 1 ] , h [ 1 9] , and h [20] are all represented 
by zero. With 4-bit precision, a total of 16 values within the ranges 0 < k < 7 
and 13 < k < 20 are reduced to zero. In other words, the FIR filter becomes a 
17-tap filter with 8-bit precision and a 5-tap filter with 4-bit precision. 

A comparison of the frequency characteristics for the three filters, with coef- 
ficients listed in Table 14.1 1, is shown in Fig. 14.27. Noticeable differences in 
the magnitude spectrum are observed in the three implementations. The width 
of the transition band increases substantially for the FIR filter represented with 
4-bit precision. The stop-band ripple also increases with the finite-precision 
filters. The original filter has a minimum attenuation of 50 dB in the stop band. 
The minimum attenuation is decreased to 40 dB with 8-bit finite precision and 
to 20 dB with 4-bit precision. In fact, it is difficult to describe the 4-bit finite- 
precision filter as a lowpass filter since the higher-frequency components pass 
through the system with comparatively little attenuation. 

Increasing the number of bits used in the finite-precision representation gen- 
erally improves the approximation of the original filter characteristics. However, 
the increase in precision also increases the implementation cost. 


14.9 Matlab examples 


In Chapter 13, we introduced a Matlab M-file residuez for the partial 
fraction expansion of a given rational function. Similarly, the M-file tf2zp 
was introduced to calculate the location of poles and zeros for a given transfer 
function. These M-files can also be used to derive the cascaded and parallel 
forms of the transfer function. We illustrate the application of these M-files by 
deriving the cascaded and parallel forms for the transfer function, 

z 3 - 2z 2 + z 1 - 2 z- 1 + z“ 2 

' ~~ z 3 - O.lz 2 - 0.07z - 0.065 ~~ 1 - O.lz" 1 - 0.07Z" 2 - 0.065 z~ 3 ’ 

considered in Example 14.5. 


14.9.1 Parallel form 


The Matlab code to determine the partial fraction expansion is given below. 
The explanation follows each instruction in the form of comments. 


>> 

B = 

[1 

-2 1 

0] ; 

o. 

Coefficients of the 
% numerator of H(z) 

>> 

A = 

[1 

1 

o 

I— 1 

-0.07 -0.065] ; 

o. 

Coefficients of the 
% denominator of H(z 

>> 

[R, 

P, 

K] = 

residuez (B, A) ; 

O, 

Calculate partial 


% fraction expansion 

The returned values are given by 

R = [0.4310 0. 2845 + 3. 3362j 0 . 2845-3 . 3362 j ] 

P = [0.5000 -0. 2000 + 0. 3000j -0 . 2000-0 . 3000 j ] and K = 0. 

The transfer function H(z ) can therefore be expressed as follows: 

0.4310 0.2845 +j3. 3362 0.2845 -j3.3362 

HL ) ~ 1 — 0.5z-' + 1 — (— 0.2 + j0.3)z- 1 + 1 — (—0.2 — j0.3)z~ 1 ' 

To eliminate complex-valued coefficients, we combine the complex poles as 
follows: 


0.4310 | 0.5690- 1.8879z _1 

1 -0.5Z" 1 + 1 +0.4z-> +0.13Z" 2 ' 


The partial fraction expansion is then implemented using the parallel form as 
shown in Fig. 14.25. 


14.9.2 Series form 


The Matlab code to determine the poles and zeros of H( z) is given by 

» B = [0 1 — 2 1] ; % The numerator of H(z) 

» A = [1 —0.1 —0.07 —0.065] ; % The denominator of H(z) 

» [Z, P, K] = tf2zp(B, A); % Calculate poles and 

% zeros 

The locations of the poles and zeros are given by 

z = [oil] 

P = [0.5000 -0 .2000 + 0 ,3000j -0 . 2000-0 . 3000j ] and K = 1. 
The transfer function H (z) can therefore be expressed as follows: 

= j (l-Oz-'Xl-lz-'Kl-U- 1 ) 

(1 - 0.5z _1 )(l - (— 0.2 + j0.3)z _1 )(l - (—0.2 — j0.3)z _1 ) 

= d-z " 1 ) 2 

(1 - 0.5z -1 )(l - (-0.2 + j0.3)z- 1 )(l - (-0.2 - j0.3)z- 1 )' 

Combining the complex roots in the denominator, the cascaded configuration 
is given by 

H( ) = 1 x 1 -z -1 

1 — 0.5z _1 X 1 + 0.4z _1 + 0.13z -2 ' 

The cascaded configuration is then implemented using the series form as shown 
in Fig. 14.23. 


14.10 Summary 


Chapter 14 defined digital filters as systems used to transform the frequency 
characteristics of the DT sequences, applied at the input of the filter, in a prede- 
fined manner. Based on the magnitude spectrum \H(D)\, Section 14.1 classifies 
filters in four different categories. A lowpass filter removes the higher-frequency 
components above a cut-off frequency 17 C from an input sequence, while retain- 
ing the lower-frequency components 12 < l? c . A highpass filter is the converse 
of the lowpass filter and removes the lower-frequency components below a cut- 
off frequency 12 C from an input sequence, while retaining the higher-frequency 
components 17 > 17 C . A bandpass filter retains a selected range of frequency 
components between the lower cut-off frequency 12 c i and the upper cut-off 
frequency 17 C 2 of the filter. A bandstop filter is the converse of the bandpass 
filter, which rejects the frequency components between the lower cut-off fre- 
quency !? c i and the upper cut-off frequency 17 C 2 of the filter. All other frequency 
components are retained at the output of the bandstop filter. 

Section 14.2 introduces a second classification of digital filters based on the 
length of the impulse response h [A:] of the digital filter. Finite impulse response 


(FIR) filters have a finite length impulse response, while the length of infinite 
impulse response (HR) filters is infinite. The ideal frequency-selective filters, 
introduced in Section 14.1, are not practically realizable because of constant 
gains within the pass band and stop band, the sharp transitions between the 
pass band and the stop band, and because of the zero phase. Sections 14.3 and 
14.4 explore practical realizations of the ideal filter obtained by allowing some 
variations in the pass-band and stop-band gains, introducing a linear-phase 
within the pass band, and by leaving some transitional bandwidth between 
the pass band and the stop band. The transition bandwidth allows the filter 
characteristics to change gradually. Section 14.3 also proved the following 
sufficient condition for ensuring a linear phase for FIR filters. If the impulse 
response function of an IV-tap filter, with z-transfer function given by Eq. ( 14.7), 
satisfies either of the following relationships: 

symmetrical impulse response h[k] = h[N — 1 — k]; 

antisymmetrical impulse response h[k] = —h[N — 1 — k], 

then the phase <//(!?) of the filter is linearly proportional to the frequency. 

When implementing digital filters on digital computers or specialized DSP 
boards, the output of a digital filter is obtained by solving the following recursive 
formula: 


1 

y[k] = (cny[k — 1] H b a N y[k - N]) 

flo 

1 

H ( b 0 x[k ] + b\x[k — 1] H b b M x[k - M]). 

ao 

Based on the aforementioned formula, Sections 14.5-14.7 derived physical real- 
izations of digital filters using three fundamental elements: a two-input adder, 
a scalar multiplier, and a unit delay. For FIR filters, direct form, series form, 
and parallel forms are derived in Section 14.6. The series form is obtained by 
factorizing the transfer function in terms of a product of quadratic polynomials 
and then cascading the transfer function for the individual quadratic polynomi- 
als. The parallel form is obtained by partial fraction expansion of the transfer 
function. Section 14.7 derived similar realizations for HR filters. For both FIR 
and HR filters, alternative flow diagrams are obtained by applying the transpose 
operation. Transposition of a flow graph is achieved by (i) interchanging the 
role of the input and output; (ii) reversing the directions of all branches within 
a flow graph; and (iii) replacing the source nodes with adders and the adders 
with source nodes. 

Direct form II, the series form, and the cascaded form are defined as canon- 
ical representations since there forms, in general, use the minimal number of 
fundamental elements, whereas direct form I is referred to as a non-canonical 
representation. Irrespective of the arithmetic complexity, all of these realizations 
provide identical outputs for the same input sequence. 


During the actual realization of digital filters in software or hardware, the 
filter coefficients are implemented with finite precision. Section 14.8 discussed 
the impact of finite-precision arithmetic on the performance of digital fil- 
ters. It is observed that the effect of finite-precision arithmetic varies from 
one realization of the filter to another. We list in the following some empir- 
ical observations that should be kept in mind while choosing a particular 
realization. 

(i) When the poles of the transfer function lie close to each other or close to 
the unit circle in the complex z-plane, direct form realizations, with filter 
coefficients represented using finite precision, produce large deviations 
from the output of an exact filter. 

(ii) The order in which the first- and second-order systems are implemented 
in cascaded forms affects the output of the filter in finite-precision imple- 
mentations. Changing the order may reduce the deviation from the output 
of an exact filter. 

(iii) Pairing of complex poles and zeros is important for all cascaded and 
parallel realizations. 

(iv) In cascaded realizations, scalar multipliers between different systems may 
be required to prevent the partial fraction coefficients from becoming too 
large or too small. 

Section 14.9 presented two Matlab functions, residuez and tf 2zp, for 
deriving the physical realizations of digital filters. 


Problems 


14.1 Determine if the filters represented by the following transfer functions are 
(a) FIR or HR, and (b) causal or non-causal. If a filter is FIR, determine 
if its phase is linear. 

(i) H(z) = 0.7 + 0.2z _1 + 0.8z -2 ; 


(ii) H(z) = 


1 

3 


(z + 1 + z ') 


(iii) H(z) = 

(iv) H(z) = 


0.7 + 0.2z -1 + 0.8z -2 _ 
1 + 0.5-- 1 - 0.24;r 2 ’ 
1 -O.lz” 1 -0.06-- 2 
1 + 0.2Z- 1 ' 


14.2 Consider two filters with transfer functions given by 


Hi (z) — 1 + 2z 1 + 3z 2 + 2z 3 + z 4 and 
H 2 (z) = 1 + 2z -1 + 3z -2 + 2z~ 3 - z~ 4 . 


Fig. P14.5. The FIR system for 
Problem 14.5. 



(i) Determine and plot the frequency characteristics of the filters. 

(ii) If the sequence x[k] cos(0.5&) + cos(k) is applied at the input of 
filter H\(z), determine the output of the filter from the frequency 
characteristics obtained in (i). 

(iii) Repeat (ii) for filter Hi{z). What advantage do you see with the 
linear-phase filter? 


14.3 Consider a digital filter with impulse response given by 


hlk] = 


1/3 

0 


-1 <k< 1 

otherwise. 


(i) Calculate the transfer function of the filter. 

(ii) Sketch the amplitude and phase responses of the filter with respect 
to frequency. 

(iii) How will you classify this filter - lowpass, bandpass, bandstop, or 
highpass? 

(iv) Does it have a linear phase? 


14.4 Consider a digital filter with transfer function given by 

0.7 + 0.2 z" 1 + 0.8z -2 
U)_ 1 + 0.5Z- 1 - 0.24z- 2 ' 

(i) Plot the impulse response and the frequency characteristics of the 
filter. 

(ii) From the frequency characteristics, determine the maximum magni- 
tude of the pass-band and stop-band ripples and the transition band- 
width. 


14.5 Given the flow graph in Fig. P14.5, calculate the transfer function and the 
impulse response of the LTI system of the realization. From the transfer 
function, calculate the magnitude and phase spectra for the filter. 

14.6 The flow graph of Fig. P14.5 can be implemented by using only three 
scalar multipliers. Sketch the flow graph which uses three scalar multipli- 
ers without increasing the number of delay elements or two-input adders. 

14.7 Repeat Problem 14.5 for the flow graph shown in Fig. P14.7. 

14.8 Draw the flow graphs for (i) the direct form and (ii) the cascaded form 
for an FIR filter with a transfer function given by 

H(z) = 0.4-0.8Z- 1 +0.4z- 2 . 


Fig. P14.7. The HR system for 
Problem 14.7. 
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14.9 Using the principle of transposition for the flow graphs, derive two alter- 
native representations for the FIR filter specified in Problem 14.8. 

14.10 Draw the linear-phase flow graph for the FIR filter specified in Problem 
14.8. 


14.11 The transfer function of an HR filter is given by 
H(z) = (1 -0.25Z” 1 ) 8 . 


Draw the flow graphs based on the following forms: (i) cascade of eight 
first-order FIR systems; (ii) cascade of four second-order FIR systems; 
(iii) cascade of two third-order FIR systems and one second-order FIR 
system; (iv) cascade of two fourth-order FIR systems; (v) cascade of one 
sixth-order FIR system and one second-order FIR system. Compare the 
computational complexity of each realization. 


14.12 The transfer function of an HR filter, with impulse response given by 


h[k] = 0.5 sin I -k )u[k] 


Jt 


is given by the following expression: 
0.5z sin ( — 

H{z)= ^ 

z 2 — 2 x 0.5 cos ( — )z + 0.25 


0.3536z 


0.7071z + 0.25 


Draw the flow graphs for (i) direct form I, (ii) direct form II, (iii) the 
cascaded form, and (iv) the parallel form realizations of the HR filter. 


14.13 Using the principle of transposition for the flow graphs, derive four 
alternative flow graph representations for the HR filter specified in 
Problem 14.12. 


14.14 The transfer function of a digital system is given by 

1 -0.8Z- 1 +0.15z- 2 


H(z) = 


1 - 0.7z 


-l 


0 . 1 8 z 


-2 ' 


Draw the flow graphs for (i) direct form I, (ii) direct form II, (iii) the 
cascaded form, and (iv) the parallel form realizations of the HR filter. 


14.15 U sing the principle of transposition for the flow graphs, derive four alter- 
native flow graph representations for the HR filter specified in Problem 
14.14. 


14.16 An allpass filter has a constant gain for all frequencies, i.e. = 1 . 

(i) Show that the transfer functions 


Hi(z) = 


«i + z 1 
1 + a\z~ x 


and 


H 2 (z) = 


oi\a 2 + ai z 1 + Z 2 
1 + oqz -1 + u 2 z~ 2 


represent allpass filters. 

(ii) Sketch the flow graph for the first-order allpass filter which 

uses a single scalar multiplier. 

(iii) Sketch the flow graph for the second-order allpass filter H 2 (z) with 
only two scalar multipliers. There is no restriction on the number 
of unit delay elements or two-input adders in each case. 

14.17 The impulse response of an LTID system is given by 


h[k] = 



0 < k < 9 
elsewhere. 


(i) Draw the flow graph for the above LTID system with no feedback 
paths. 

(ii) The z-transfer function for the above impulse response is given by 


H(z) = 


1 -a w Z - 10 
1 — az~ x 


Draw the flow graph of the HR system specified by this transfer 
function. 

(iii) Compare the two implementations with respect to the number of 
delays, scalar multipliers and two-input adders. 

14.18 Implement the filter with transfer function given by 


H(z) = 0.4 - 0.8z _i + 0.4-T 2 


with finite-precision arithmetic given by 

(— l) s x (0 + O.significand), 

where the significand represents the decimal fraction of the coefficients 
and is limited to 3 bits with 1 bit allocated for the sign. Compare the 
magnitude response of the original filter with the magnitude response of 
the filter implemented with finite-precision representation. 


14.19 Repeat Problem 14.14 for the following transfer function 

1 — 0.8z -1 + 0.15z -2 
1 — 0.7z _1 — 0.18z -2 

14.20 Repeat Problem 14.14 for the following transfer function 


0.5z sin 


H(z) = 




cos I ^ )z + 0.25 


CHAPTER 



FIR filter design 


In Chapter 14, we defined frequency-selective filters as systems that modify 
the frequency components of the input signals in a predefined manner. Further 
classification of frequency- selective filters is based on the length N of their 
impulse responses h [£] . If the length N of the impulse response of a frequency- 
selective filter is finite, the filter is referred to as a finite impulse response (FIR) 
filter. If the length N is infinite, the frequency-selective filter is referred to as 
an infinite impulse response (HR) filter. In this chapter, we consider the design 
of frequency-selective FIR filters. 

The design of digital filters involves three distinct stages. Stage 1 describes 
the desired specifications of the frequency characteristics of the filter. Based 
on the specified frequency characteristics, stage 2 derives the transfer function 
H(z), or the impulse response li[k], of the filter. Finally, stage 3 develops the 
canonical realization of the filter using one of the several forms presented in 
Chapter 1 4. While deriving the impulse response h \k\ of an FIR filter in stage 2, 
the following two conditions must also be satisfied. 

(1) Causality condition. This implies that the impulse response h[k] of an FIR 
filter is zero for k < 0. This will ensure a causal, and hence a physically 
realizable, filter. 

(2) Linear-phase condition. This implies that the impulse response h[k] of 
an FIR filter of length N is symmetrical or anti-symmetrical, i.e. h[k] = 
±/i [N — 1 — k]. The linear-phase condition ensures that no distortion is 
introduced in the input frequency components lying within the pass band 
of the FIR filter. 

Generally, FIR filters are designed directly from the impulse response of an 
ideal lowpass filter. Section 15.1 describes the windowing approach, where an 
appropriate window function w [k] is used to truncate the impulse response of 
an ideal lowpass filter to a finite length N . The specifications of the FIR filter, 
along with the characteristics of the window function, are used to calculate 
the length N of the FIR filter. Sections 15.2 and 15.4 extend the windowing 
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approach to the design of highpass, bandpass, and bandstop FIR filters. The FIR 
filter design techniques, based on the windowing function, can result in several 
alternative designs, all of which satisfy the given specifications. Section 15.5 
presents the Parks-McClellan method, which recursively computes the opti- 
mal filter for a given length N. Section 15.6 presents several library functions 
available in M ATL AB to design FIR filters. Finally, the chapter is concluded in 
Section 15.7. 


15.1 Lowpass filter design using windowing method 


In Section 14.1, it was shown that the impulse response of an ideal lowpass 
filter is a sine function, and therefore that an ideal lowpass filter is non-causal 
and HR. In Section 14.4, it was shown that a causal lowpass FIR filter can 
be obtained by delaying the ideal impulse response by m time units (see Fig. 
15.1a) and truncating the impulse response. To generate an N-tap FIR filter, the 
truncation of the ideal impulse response is performed as follows: 


hi P M = 




Q c 

— sine 

jt 


0 


( k — m)S ? c 


0 < k < N - 1 
elsewhere; 


(15.1) 


where the value of m in Eq. (15.1) is selected to be (N — l)/2. This approach 
of designing an FIR filter is referred to as the windowing method, and is shown 
in Fig. 15.1. Note that the impulse response h\ p [k] of the resulting FIR filter is 
non-zero only within the range 0 < k < N— 1 . In addition, the impulse response 
h\ p [k] is symmetrical about k = (N — l)/2, i.e. 


h[k] = h[N - 1 -k], (15.2) 

and satisfies the linear-phase condition given in Eq. (14.8a). If N is an odd- 
valued integer, the resulting FIR filter is a type 1 linear-phase filter with an 
integer delay m. On the other hand, if N is an even-valued integer, the resulting 
FIR filter is a type 2 linear-phase filter with a fractional delay m . 

Truncating the impulse response of an ideal lowpass filter affects the fre- 
quency characteristics of the ideal lowpass filter. In addition to introducing 
ripples within the pass and stop bands, the truncation leads to a transition band 
between the pass band and the stop band. In the following subsection, we ana- 
lyze the effect of truncating the impulse response h\ p [k] of the ideal lowpass 
filter with a rectangular window of length N. 


15.1.1 Rectangular window 

The rectangular window of length N, centered at k = (N — l )/2, is defined as 
follows: 


Wrect [k] — 


1 0 < k < N - 1 

0 otherwise, 


(15.3) 
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(a) 


(b) 



(e) (f) 

Fig. 15.1. Windowing operation to derive a truncated FIR filter from an ideal lowpass filter. The left-hand 
column (plots (a), (c), and (e)) represents the windowing operation in the time domain, and the right-hand 
column (plots (b), (d), and (f)) represents the windowing operation in the frequency domain, (a) Impulse 
response /)|| p [A:] of an ideal lowpass filter, (b) Magnitude spectrum |Wj| p (T2)| of an ideal lowpass filter. 

(c) Rectangular window to rec t[A:]. (d) DTFT W, ea (S7) of the rectangular window, (e) Impulse response 
h\ p [k] = /hip M u'rectM of the truncated lowpass filter, (f) Magnitude spectrum 
\H\ V (Q)\ = |(l/27r)Wiip(T2) * l/R re ct(T2)| of the truncated lowpass filter. 


where we have assumed that the length N of the windowing function is odd. 
Taking the DTFT of Eq. (15.3) results in the following frequency characteristics 
for the rectangular window: 


Wiec,(fl) = e- 


sin(lV 17/2) 
sin(J?/2) 


(15.4) 


The rectangular window w rec t[k] and its magnitude spectrum |VF rec t(mi are 
illustrated in Figs. 15.1(c) and (d), respectively. The narrow lobe, centered at 
Q — 0, in VF r ect(l7) is referred to as the main lobe, while the lobes on each side 
of the main lobe are referred to as the side lobes of the rectangular window. 
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Truncating the impulse response /!;i p [A:] of the ideal lowpass filter to length 
N is the same as multiplying the impulse response lin p [k] by the rectangular 
window in the time domain. The truncation operation is, therefore, modeled as 
follows: 


h ]p\k I — ^ilp[k]w rec t[k], (15.5) 

with m = (N — l)/2. The result of the truncation step is illustrated in Fig. 
15.1(e). Since multiplication in the time domain is equivalent to convolution in 
the frequency domain, the transfer function of the truncated FIR filter is given 
by 

tfip(ft) = tOT * ffiip(^)] = 2 ^ f //iip(Wect(0 - n)M, (15.6) 

(2 7T) 

which results in the magnitude spectrum shown in Fig. 15. 1(f). Comparing the 
magnitude spectrum | H l \ p (fl)\ of the ideal lowpass filter with the magnitude 
spectrum H\ p (Q)\ of the truncated lowpass filter, we note three major differ- 
ences. First, there are significant ripples within the pass band of the truncated 
lowpass filter. Secondly, the magnitude spectrum of the truncated lowpass fil- 
ter does not change abruptly in between the pass band and stop band. In fact, 
a transition band of finite width appears. Thirdly, there are additional ripples 
within the stop band of the truncated lowpass filter. The appearance of ripples in 
the pass band and stop band is referred to as the Gibbs phenomenon. In order to 
reduce the ripples and eliminate the transition band, the DTFT W rec t(12) should 
be a narrow impulse function. This would imply that the length N of the win- 
dowing function is very large, increasing the implementation complexity of the 
truncated lowpass filter. 

In Fig. 1 5 . 1 (c), we observe that the rectangular window has abrupt truncations 
outside the range 0 < k < N — 1 . The pass-band and stop-band ripples, as well 
as the transition band, can be decreased by selecting alternative windows that 
taper smoothly to zero from the peak value of 1 at k = (N — l)/2. Section 
15.1.2 discusses several alternatives to the rectangular window. 


15.1.2 Commonly used windows 

There are a number of alternatives to the rectangular window. A few popular 
choices are defined in the following. 

Bartlett (triangular) window 

2k 

0 < k < (N - l)/2 


Wbart[T] — 


0 


N - 1 


(N - l)/2 < k < N - 1 
otherwise. 


(15.7) 
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Fig. 15.2. Commonly used 
windows of length N . 



Generalized Hamming window For 0 < a < 1 , 

f 2: rk 1 

a — (1 — a) cos 0 < k < N — 1 

W genet*] = L^-l. 

0 otherwise. 

Hamming window 

WhammM = 

Hanning window 


■ 

0.54- 

0.46 cos 

2 Ttk 

N - 1 

0 




Whannl*] — 

Blackman window 

WblacI*] 


I 

in 

© 

- 0.5 cos 

2t rk 

N - 1 

0 




0<k<N ! 

otherwise. 

0 < k < (N - 1) 
otherwise. 


(15.8) 


(15.9) 


(15.10) 


' 

0.42 — 0.5 cos 

2nk 

+ 0.08 cos 

4itk 

N - 1 

N - 1 


0 





0 < k < N — 1 

otherwise. 

(15.11) 


The shapes of the windows are shown in Fig. 15.2, where, for convenience of 
illustration, continuous plots are used. In reality, the windows are a function of 
the DT variable k. It may be noted that the Hamming and Hanning windows are 
special cases of the generalized Hamming window. For the Hamming window, 
variable a in Eq. (15.8) of the generalized Hamming window equals 0.54. 
Similarly, for the Hanning window, variable a in Eq. (15.8) equals 0.5. 

The DTFTs of the aforementioned windows are shown in Fig. 15.3, where 
the vertical axis represents the magnitude of the DTFTs based on the decibel 
(dB) scale. The two important parameters used in the FIR filter design are (i) the 
width of the main lobes of the DTFT of the windows; (ii) the relative strength 
of the highest value side lobe with respect to the main lobe. The width of the 
main lobe is defined as the distance between the nearest zero crossings of the 
main lobe, while the relative side lobe strength is defined as the difference in 
dB between the magnitudes of the highest value side lobe and the main lobe. 
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(a) (b) 




0 0.2 n 0.471 0.6 k 0.8k k 0 0.2;r 0.4k 0.6k 0.8k k 

(c) (d) 


Fig. 15.5. DTFTs of commonly 
used windows with length 
N = 75. (a) Rectangular 
window; (b) Bartlett window; 

(c) Hanning window; 

(d) Hamming window; 

(e) Blackman window. 



0 0.2 K 0.4 K 0.6 K 0.8k k 


(e) 
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Table 15.1. Comparison of the properties of the commonly used windows 


Window 

Width of 
main lobe 

Peak side lobe 
amplitude*"' (dBj 

Max. stop/pass-band 
error 201ogio(5) 

Kaiser window'*' 

P 

transition width 

Rectangular 

An IN 

-13.3 

-21 

0 

1.81tt/(A7 - 1) 

Bartlett 

&n/(N- 1) 

-26.5 

-25 

1.33 

2.37jt/(1V - 1) 

Hanning 

8n/(N— 1) 

-31.4 

-44 

3.86 

5.01jr/(lV - 1) 

Hamming 

8n/(N— 1) 

-42.6 

-53 

4.86 

6.27n/(N - 1) 

Blackman 

I2n/(N— 1) 

-58.0 

-74 

7.04 

9A9n!{N - 1) 


"The peak side lobe magnitude in column 3 is relative to the magnitude of the main lobe. 
*The last two columns for the Kaiser window are explained in Section 15.1.5. 


The second and third columns of Table 15.1 compare these two parameters for 
the commonly used windows as a function of the length N of the window. The 
fourth column of Table 15.1 quantifies the maximum difference between the 
magnitude spectra within the pass and stop bands of the ideal lowpass filter and 
the causal FIR filter obtained from the windowing method. In other words, it 
provides an upper bound on the values of the ripples in the pass and stop bands 
of the causal FIR filter. For example, the maximum pass- and stop-band error of 
-21dB for the rectangular window implies that the pass- and stop-band ripples 
are confined to -21dB in the FIR filter obtained with the rectangular window. 

In filter design, we prefer to minimize the transition band and reduce the 
strength of the ripples. These are conflicting requirements, as we see next. 
To minimize the transition band in the FIR filter, the main lobe width of the 
windows should be as small as possible. To reduce the pass-band and stop- 
band ripples in the FIR filter, the area enclosed by the side lobes (in other 
words, the relative strength of the side lobes) of the windows should be small. 
Table 15.1 illustrates that these two requirements are contradictory. The rect- 
angular window has the smallest width main lobe, but the relative strength of 
its highest side lobe with respect to the main lobe is the largest. As a result, 
for the rectangular window, the transition bandwidth is small, but the ripple 
magnitude is large. On the contrary, the relative strength of the side lobe for the 
Blackman window is the smallest, but the width of its main lobe is the largest. 
In other words, for the Blackman window, the transition bandwidth is large, but 
the ripple magnitude is small. 

In the following example, we illustrate the effect of the rectangular and 
Hamming windows on the frequency characteristics of an ideal lowpass filter 
truncated with these windows. 

Example 15.1 

Calculate the impulse response of an ideal DT lowpass filter with radian cut- 
off frequency f2 c = 1. From the ideal filter, design two 21 -tap FIR filters with 
fi c = 1 using the rectangular and Hamming windows. 
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(a) (b) 


Fig. 15.4. Impulse response of 
FIR filters obtained by truncating 
the impulse response of the 
ideal lowpass filter with (a) a 
rectangular window and (b) a 
Hamming window. 


Solution 

Substituting = 1 in Eq. (14.12), the impulse response of an ideal lowpass 
filter is given by 




sin(£ — m) 
(k — m)jT 


1 

— sine 

TT 



(15.12) 


wherem = (N — l)/2 = 10. The expressions for the rectangular and Hamming 
windows with 21 taps are as follows: 


rectangular window w rec tOT 


1 0 < k < 20 
0 otherwise; 


(15.13) 


Hamming window Whamm[^] = 


0.54 — 0.46 cos 
0 



0 < k < 20 
otherwise. 


(15.14) 


The FIR filters are obtained by multiplying the impulse response of the ideal 
lowpass filter by the expressions for the rectangular and Hamming windows. 
The resulting impulse responses are as follows: 


rectangular window /! rect [Ar] 


1 

— sine 

TT 


0 


it - 10 


TT 


0<k<20 

(15.15) 

otherwise; 


Hamming window hhammOT 

) 20 (15.16, 

0 otherwise. 

The impulse responses for FIR filters obtained by truncating the ideal lowpass 
filter impulse response with the rectangular and Hamming windows are shown in 
Fig. 15.4. Although the two impulse responses have the same value at k = 10, 
the impulse response /ihamm[t], shown in Fig. 15.4(b), decays more rapidly 
as we move away from the central point (k = 10) and is different from the 
impulse response /z rec tOT, shown in Fig. 15.4(a). Typically, the pass-band gain 
of the truncated FIR filters, obtained from the ideal lowpass filters using the 
windowing method, is not unity, as desired. To prove this, we calculate the value 


1 . /(*- 10 ) 

— sine I 

TT \ TT 


0.54 — 0.46 cos 


Ink 

~W 
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\H(Q)\ 201og 10 |ff(fl)| 




Fig. 15.5. Magnitude spectra of the FIR filters obtained by truncating the impulse response of the ideal 
lowpass filter with the rectangular and Hamming windows. The magnitude spectrum of the FIR filter 
obtained from the rectangular window is plotted as a solid line, and the magnitude spectrum of the FIR 
filter obtained from the Hamming window is plotted as a dashed line, (a) Plotted using a linear scale for 
the gain, (b) Plotted using a dB scale for the gain. 


of /-/| p (0) by substituting Q — 0 in the DTFT H\ p (i 7): 


OO 

tfip(O) = 

k——oo 


n = o 


OO 


E m*]- 


(15.17) 


Equation (15.17) can therefore be used to calculate the pass-band gain atf? = 0. 
Using the values of the samples plotted in Figs. 15.4(a) and (b), the values of 
the gain of the two truncated filters at fi = 0 are given by 

OO 

rectangular window Hrect(O) = h iect [k] = 0.9754; 

k=—o o 

OO 

Hamming window Hhamm(O) = E /thammM = 0.9982. 

k = — oo 


To ensure a unity gain in the pass band, the impulse response corresponding 
to the rectangular window in Eq. (15.15) is normalized by a factor of 0.9754. 
Similarly, the impulse response corresponding to the Hamming window is nor- 
malized by a factor of 0.9982. The resulting magnitude spectra of the two 
normalized FIR filters are shown in Fig. 15.5, where the gains of the filter are 
plotted on a linear scale in Fig. 15.5(a) and on a logarithmic scale in Fig. 15.5(b). 
It is observed that the dc gain, defined as the gain of the filter at ft = 0, for both 
filters is unity. The rectangular window results in higher pass-band and stop- 
band ripples. However, the rectangular window provides a smaller transition 
band than the Hamming window. 

From Fig. 15.5(b), we quantify the gain in the stop band for the FIR filter 
obtained using the Hamming window and compare its value with the stop-band 
gain for the FIR filter obtained using the rectangular window. The maximum 
gain in |T/h amm (f2)| i s l ess than —50 dB in the stop band (12 > 0.49 tt). Equiv- 
alently, we can also say that the minimum attenuation in the stop band of the 
Hamming window is greater than 50 dB. The maximum gain in |7/hamm(f2)l. 
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Fig. 15.6. Desired specifications 
of a lowpass filter. 





obtained from the rectangular window, is about —22 dB for fi > 0.31 it . In other 
words, the Hamming window attenuates the higher-frequency components of 
the input signals more strongly than the rectangular window. As discussed ear- 
lier, this improvement in the stop-band attenuation is at the expense of a higher 
transitional bandwidth in the truncated FIR filter obtained from the Hamming 
window. 


15.1.3 Design of FIR lowpass filters 

We now list the main steps involved in the design of FIR filters using the 
windowing method. The design specifications for a lowpass filter are illustrated 
in Fig. 15.6 and are given by 

pass band (0 < ft < l? p ) (1 — <5 p ) < |//i p (J?)| < (1 — <5 P ); 
stop band (J? s < ft < it) 0 < |//i p (f7)| < <5 S . 

Expressed in decibels (dB), 201og 10 (<S p ) is referred to as the pass-band ripple 
or the peak approximation error within the pass band. Similarly, 201og 10 (<5 s ) is 
referred to as the stop-band ripple or the peak approximation error in the stop 
band. The stop-band ripple can also be expressed in terms of the stop-band 
attenuation as —20 log 10 (<5 s ) dB. 

For digital filters, the pass and stop bands are generally specified in the DT 
frequency Q domain, which is limited to the range 0 < Q < 2n . A DT system 
may also be used to process a CT signal. The schematic representation of such 
a system was shown in Fig. 9.1. In such cases, it is possible that the pass and 
stop bands of the overall system are specified in the CT frequency a> domain 
and we are required to compute the transfer function of the DT system shown as 
the central block in Fig. 9.1. We assume that the sampling frequency /o used in 
the analog to digital (A/D) converter is known. The following nine steps design 
an FIR filter using the windowing method. 
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Step 1 Calculate the normalized cut-off frequency of the filter based on the 
following expressions: 

DT frequency 1? specifications 

cut-off frequency, l? c = 0.5(f2 p + f2 s ); 
normalized cut-off frequency, t? n = i7 c /jr; 

CT frequency u> (or /) specifications 

cut-off frequency, co c = 0.5(u> p + a > s ) or f c — 0.5 (/ p + / s ); 

normalized cut-off frequency, l? n = = gyy . 

Note that the for CT specifications, a> v and <o s denote the pass-band and stop- 
band edge frequencies in radians/s, and / p and f s denote the pass-band and stop- 
band edge frequencies in Hz, respectively. The above frequency normalization 
scales the DT frequency range [0, jr] to [0, 1]. For CT, the frequency range 
[0, 0.5(Uo] (i n radians/s) or [0, 0.5/o] (in Hz) is scaled to [0, 1]. The normalized 
cut-off frequency fi n can have a value in the range [0, 1]. 


Step 2 The impulse response of an ideal lowpass filter is given by 


/hlp[^] — 


sin((£ — m)Q c ) 

( k — ni)7T 


C c 

— sine 

TV 


(k — m)f2 c 


7T 


f? n sinc((fc — 


where l? c = 7rl? n and m = (N — l)/2, where N is the filter length to be cal- 
culated in step 6. Note that the DT filter impulse response /qi p [A:] primarily 
depends on the normalized frequency C n . If the DT filter is used to process DT 
signals obtained using different sampling rates, the CT cut-off frequency will 
change depending on the sampling frequency, but the fi n will remain same. 


Step 3 Calculate the minimum attenuation A using A = min(<5 p , <5 S ) and then 
convert it to the dB scale. 


Because of the nature of the windowing method and the inherent symmetry in 
the window functions, the resulting FIR filter has identical attenuations of A 
dB in both the pass and stop bands. If <5 p > <5 S , the designed filter will satisfy 
the pass-band attenuation requirement and exceed the stop-band attenuation 
requirement. Conversely, if <5 S > <5 p , then the filter will satisfy the stop-band 
attenuation requirement and exceed the pass-band attenuation requirement. 

Step 4 Use the first three columns of Table 15.2 to choose the window type 
for the specified attenuation A . 

In Table 15.2, the attenuation A, specified in the first two columns, is relative 
to the pass-band gain. For a given value of A, more than one choice of the 
window type is possible. With a minimum attenuation requirement of 20 dB, 
for example, any of the four windows may be selected. Although the higher 


676 


Part III Discrete-time signals and systems 


Table 15.2. Selection of the type of window based on the attenuation values 
obtained from step 3 


Minimum attenuation (A) 


Transition bandwidth, 
Ah? n 

dB 

linear scale 

Type of window 

<20 

<0.1 

rectangular 

1.8/A? 

<40 

<0.01 

Hanning 

6.2/A? 

<50 

<0.003 

Hamming 

6.6/A? 

<70 

<0.00003 

Blackman 

11/A? 


attenuation windows (Hanning, Hamming, or Blackman) reduce the pass- and 
stop-band ripples, the transition bands of the resulting FIR filters obtained with 
these windows are larger than the transition band of the FIR filter obtained with 
the rectangular window. 

The first two columns of Table 15.2 are approximated directly from the fourth 
column of Table 15.1, which lists the stop-band attenuation. The last column of 
Table 15.2 is based on empirical observations. 

Step 5 Calculate the normalized transition bandwidth for the FIR filter using 
the following expressions: 

DT frequency <7 specifications 
transition BW, Ai? c = 17 S — f? p ; 
normalized transition BW, Al? n = AC c /jr; 

CT frequency specifications 

transition BW, A<w c — co s — a> p or A/ c = / s — / p ; 

A co c A/ c 

normalized transition BW, Al? n = = . 

0.5&>o 0.5 fo 

Step 6 Using the last column of Table 15.2, determine the minimum length 
N of the biter for the computed transitional bandwidth A j? n obtained in step 5 
and the window function selected in step 4. 

Step 7 Determine the expression w[k ] for the window function using the 
window type selected in step 4 for length N obtained in step 6. The expression 
for the rectangular window is given in Eq. (15.3), while the expressions for the 
remaining window functions are specibed in Eqs. (15.7)— (15. 11). 

Step 8 Derive the impulse response h\ v [k] of the FIR biter: 

= h ilp [k]w[k]. 

If the pass-band gain |//i p (0)| at Q = 0, given by li\ v [k], is not equal to one, 
we normalize h\ p [k] with hi p [k], where denotes the summation operation. 
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Step 9 Confirm that the impulse response h\ p [k] satisfies the initial specifica- 
tions by plotting the magnitude spectrum \h\ p (k)\ of the FIR filter obtained in 
step 8. 

We illustrate the working of the aforementioned FIR filter design algorithm in 
Example 15.2. 

Example 15.2 

Figure 9.1 is used to process a CT signal with a digital filter. The overall 
characteristics of the CT system, modeled with Fig. 9.1, are specified below: 

(i) pass-band edge frequency (&> p ) = 3: r kradians/s (or 1500 Hz); 

(ii) stop-band edge frequency (cu s ) = 47r kradians/s (or 2000 Hz); 

(iii) minimum stop-band attenuation, — 201og 10 (<5 s ) = 50 dB; 

(iv) sampling frequency (/o) = 8 ksamples/s. 

Design the DT system in Fig. 9. 1 based on the aforementioned CT specifications. 

Solution 

Step 1 suggests that the cut-off frequency of the filter is given by 
co c = 0.5(&>p + <w s ) = 3.5 jt kradians/s. 

Using co o = 27r / () = 1 6tt x 10 3 , the normalized cut-off frequency is given by 

C n = ft> c /(0.5<no) = (3.5 tt x 10 3 ) / (0.5 x 2n x 8 x 10 3 ) = 0.4375. 

Based on step 2, the impulse response of the ideal lowpass filter with the 
normalized cut-off frequency l? n = 0.4375 is given by 

h ilp [k] = 0.4375 sinc(0.4375(£ - m)) 

with m set to (N — l)/2. The value of N is determined in step 6. 

Step 3 determines the minimum attenuation A to be 50 dB. 

Step 4 determines the type of window. For the minimum stop-band attenua- 
tion of 50 dB, Table 15.2 limits our choice to either the Hamming or Blackman 
window. We select the Hamming window because its length N will be lower 
than that of the Blackman window. 

Step 5 computes the normalized transition bandwidth: 

A fi n = Aa> c /(0.5coo) = (4it — 37t) x 10 3 /(0.5 x 27r x 8 x 10 3 ) = 0.1250. 
Step 6 evaluates the length N of the Hamming window: 

6.6 /N = 0.1250 IV = 8 x 6.6 = 52.8. 

Ceiling off the length of the window to the nearest larger odd integer, we obtain 
/V = 53. 
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Fig. 15.7. Magnitude spectrum 
of the FIR filter designed in 
Example 15.2. 


201og 10 |tf(fl)| 



Step 7 derives the expression for the Hamming window of length N = 53: 


Whamm[A'] — 

• 

0.54- 

- 0.46 cos 

2itk 

0<k <52 

52 



0 



otherwise. 


Step 8 gives the impulse response of the FIR filter: 


hi P [k] — 

0.4375 sinc(0.4375(k - 26)) jo.54 - 0.46 cos 

2rrk 

52 


0 



0 < k < 52 
otherwise. 


Since /tip [^] = 0.9998 ~ 1, the impulse response h\ v [k] of the FIR filter is not 
normalized with h\ v [k]. The magnitude spectrum of the FIR filter is plotted 
in Fig. 15.7 using a dB scale. We observe that the pass-band frequency com- 
ponents below fi — 1.5 kHz are passed without any attenuation. The minimum 
attenuation in the stop band is also observed to be less than 50 dB. 


15.1.4 Kaiser window 


As shown in Table 15.1, the minimum stop-band attenuation <5 in the FIR 
filter obtained using either the rectangular, Bartlett, Hamming, Hanning, or 
Blackman window is fixed. In most cases, the selected window surpasses the 
required specifications for the attenuation 8. Consider, for example, the design 
of an FIR filter with the minimum attenuation specified at 60 dB. Table 15.2 
determines that only the Blackman window can be used, and it exceeds the 
minimum attenuation requirement by 10 dB. There is no alternative choice 
available, and the selection of the Blackman window is an overkill achieved 
at the cost of a wider transition band. Several advanced windows, such as 
Lanczos, Tukey, Dolph-Chebyshev and Kaiser windows have been proposed, 
which provide control over the stop-band ripple <5 by means of an additional 
parameter characterizing the window. In this section, we introduce the Kaiser 
window and outline the steps for designing FIR filters with the Kaiser window. 
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Fig. 15.8. Kaiser windows of 
length N = 51 for different 
values of the shape control 
parameter p. 



The Kaiser window is based on the zeroth-order Bessel function of the first 
kind and is defined as follows: 


W kaiser [^] — 


' 7o [ft (7l 


N 


1 N ■ 

< k < 


1 


Iom 2 - - 2 

0 otherwise, 

(15.18) 

where m = (N — l)/2, N is the length of the filter, and /q[-] represents the 
zeroth-order Bessel function of the first kind, which can be approximated by 

i2 


m « i + 


r= 1 L 


(/S/2) 




(15.19) 


The parameter ft is referred to as the shape control parameter. By varying /i 
with respect to the window’s length N, the shape of the Kaiser window can be 
adjusted to trade the amplitude of the side lobe for the width of the main lobe 
of the DTFT of the Kaiser window. Figure 15.8 illustrates the variations in the 
shape of the Kaiser window as ft varies from 0 to 20. The length N of the window 
is kept constant at 51. From Fig. 15.8, we observe that the Kaiser window can 
be used to approximate any of the rectangular, Bartlett, Hamming, Hanning, or 
Blackman windows by appropriately selecting the value of ft. When ft — 0, for 
example, the shape of the Kaiser window is identical to the rectangular window. 
Similarly, when ft = 4.86, the shape of the Kaiser window is almost identical 
to the Hamming window. Since the shape of the window also determines the 
maximum ripples within the pass and stop bands, parameter ft is also referred 
to as the ripple control parameter. 

We now explain the last two columns included in Table 15.1 As explained 
earlier, the Kaiser window can be used to approximate the five basic windows 
covered in Section 15.1.2. The second to last column in Table 15.1 specifies the 
value of the shape control parameter ft for which the Kaiser window approaches 
the basic windows. Setting ft = 4.86, for example, will cause the shape of 
the Kaiser window to be similar to that of the Hamming window. The last 
column lists the width of the transition band of the FIR filter obtained by using 
the Kaiser window. For ft = 4.86, the Kaiser window would approach the 
Hamming window. The transition band of the resulting FIR filter obtained by 


680 


Part III Discrete-time signals and systems 


truncating the ideal lowpass filter to length N with the Kaiser window is given 
by 6.27 7T /(N — 1 ). We can explain the remaining entries in the last two columns 
of Table 15.1 in a similar fashion. 


15.1.5 Lowpass filter design steps using the Kaiser window 

The steps involved in designing a lowpass FIR filter using the Kaiser window 
are similar to those in the filter design outlined in Section 15.1.3, except for 
steps 4, 6, and 7. Below, we only include a brief description of steps 1-3, which 
are common to the two algorithms. The steps that are different are explained in 
more detail. 

Step 1 Calculate the normalized cut-off frequency i7 n of the filter. See step 1 
of Section 15.1.3 for details. 

Step 2 Determine the expression for the impulse response of an ideal lowpass 
filter: 


/! ilp [Ar] = sinc(f2 n (A: — m)), 

where m = (N — l)/2 and N is the length of the FIR filter, which is calculated 
in step 6. 

Step 3 Calculate the minimum attenuation A on a dB scale using A — min(c5 p , 

5 S ). 


Step 4 Based on the value of A obtained in step 3, calculate the shape parameter 
ft from the following: 


P = 


0 

0.5842(A - 2 1) 04 + 0.0789(A 
0.1102(A - 8.7) 


- 21 ) 


A < 21 dB 

21 dB < A < 50 dB 

A > 50 dB. 

(15.20) 


The above expression was derived empirically by J. F. Kaiser, who came up 
with the specifications of the Kaiser window. 


Step 5 Calculate the normalized transitional bandwidth A f? n for the FIR filter. 
See step 5 of Section 15.1.3 for details. 


Step 6 The length N of the Kaiser window is calculated from the following 
expression: 


N > 


L - 7.95 
2.2857T x AC n 


(15.21) 


Equation (15.21) was also derived by Kaiser from empirical observations. Select 
an appropriate value of N and then calculate m = (N — l)/2. 
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Step 7 Determine the Kaiser window by substituting the values of ft (obtained 
in step 4) and m (obtained in step 6) into Eq. (15.18). Let the determined Kaiser 
window be denoted by Wk a i sel -[£] . 

Step 8 The impulse response of the FIR filter is given by: 

h\ v [k] = /lilpMWkaiserM. (15.22) 

If the pass-band gain |//i p (0)| at Q = 0, given by li\ p [k], is not equal to one, 
we normalize h\ v [k] with h\ v [k]. 

Step 9 Confirm that the impulse response li\ p [k] satisfies the initial specifica- 
tions by plotting the magnitude spectrum |//i p (f2)| of the FIR filter obtained in 
step 8. 

Example 15.3 uses the above algorithm to design an FIR filter using the Kaiser 
window. 

Example 15.3 

Using the Kaiser window, design the FIR filter specified in Example 15.2. 

Solution 

Following steps 1-3 of Example 15.2, we determine the following values for 
the normalized cut-off frequency, impulse response of the ideal lowpass filter, 
and minimum attenuation A : 

C n = 0.4375; h Xp [k] = 0.4375 sinc(0.4375(£ - in))-, A = 50 dB. 

The value of m in the impulse response is set to (N — l)/2. 

Step 4 of Section 15.1.5 determines the value of /3: 


P = 0.110204 - 8.7) = 4.5513. 


Step 5 computes the normalized transition bandwidth: 

Af2 n = A<w c /(0.5tt>o) = (47r — 3^) x 10 3 /(0.5 x 2jr x 8 x 10 3 ) = 0.1250. 

Using Step 6, the length of the Kaiser window is given by 
A - 7.95 50 - 7.95 


N > 


2.2857 r x A f2 n 2.285; r x 0.125 


= 46.8619, 


which is rounded off to the closest higher odd number as 47. 
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Fig. 15.9. (a) Kaiser window 
w[k\ of length N = 46 and 
p = 4.5513. (b) Impulse 
response h [A] of the FIR filter 
obtained by multiplying the 
ideal lowpass filter impulse 
response by the Kaiser window 
in Example 15.3. 


Substituting f J > — 4.5513 and N = 47 in Eq. (15.22), the expression for the 
Kaiser window is given by 


W kaiser [^] — 


/ 0 [4.55 13 (Vl - [0t- 23)/23] 2 ) 
/ 0 [ 4 . 5 5 1 3 ] 

0 


0 < k < 46 
otherwise. 


The impulse response of the FIR filter is then given by h[k] = hi\ v [k] wtaiserW- 

Figure 15.9(a) plots the time-domain representation of the Kaiser window of 
length N — 47 and shape control parameter /f = 4.55 13, and Fig. 15.9(b) plots 
the impulse response of the FIR filter. 

The frequency characteristics of the FIR filter are shown in Fig. 15.10. Since 
^ h [ k ] = 0.9992 ~ 1 , the impulse response h [k] of the FIR filter is not normal- 
ized by ^2 h[k]. It is observed that the FIR filter meets the design specification. 
The stop-band attenuation is lower than 50 dB. 

By comparing the results of Example 15.3 with those of Example 15.2, we 
observe that the FIR filter obtained from the Kaiser window in Example 15.3 has 
a smaller length N = 47 than the FIR filter obtained from the Hamming window 


Fig. 15.10. Magnitude response 
of the lowpass FIR filter 
designed in Example 15.3. 


201og 10 |//(fl)| 
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in Example 15.2, which has a length of IV = 53. Therefore, the Kaiser window 
provides an FIR filter with a lower implementational cost. This reduction in 
cost is attributed to the flexibility in the Kaiser window of closely meeting the 
stop-band attenuation of 50 dB. The stop-band attenuation in the Hamming 
window is fixed to 60 dB and cannot be varied. 

Example 15.4 

Design a lowpass FIR filter based on the following specifications: 

(i) cut-off frequency l? c = 0.3636 n radians/s; 

(ii) transition width Af2 c = 0.0727^ radians/s; 

(iii) pass-band ripple 201og 10 (l + <5 p ) < 0.07 dB; 

(iv) stop-band attenuation — 201og 10 (i5 s ) > 40 dB. 

Solution 

The specifications for the digital filter are specified in the DT frequency fi 
domain. 

Step 1 suggests that the normalized cut-off frequency is given by 


Step 2 determines the impulse response of the ideal lowpass filter with the 
normalized cut-off frequency l? n = 0.3636: 


with m set to ( N — l)/2. 

Step 3 determines the value of the minimum attenuation A. The pass-band 
ripple 201og 10 (l + <5 p ) is limited to 0.07 dB. Expressed on a linear scale, we 
obtain 5 p < 0.0081. Similarly, the stop-band ripple 201og 10 (<5 s ) is limited to 
—40 dB, which implies 5 S < 0 .01. The value of the minimum attenuation is 
therefore given by A = min(0.0081, 0.01) = 0.0081. Expressed in decibels, the 
value of the minimum attenuation is — 201og 10 (A) = 41.83 dB. 

Step 4 determines the value of the shape control parameter fi from 
Eq. (15.20): 

P = 0.5842(A - 2 1) 0,4 + 0.0789(A - 21) = 3.6115. 

Step 5 computes the normalized transition bandwidth: 


Q n = (0.3636jr)/;r = 0.3636. 


h iip [k] = 0.3636 sinc(0.3636(fc - m)). 


Al7 n = = 0.0727. 


Step 6 determines the length of the Kaiser window: 


A - 7.95 41.83 - 7.95 



= 64.92, 


which is rounded off to the closest higher odd number as 65. 
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Fig. 15.11. Magnitude response 
of the lowpass FIR filter 
designed in Example 15.4. 


201og 10 |i/(fl)| 



Substituting fi = 3.6115 and N — 65 in Eq. (15.22), the expression for the 
Kaiser window is given by 


Wkaiserl^] — 


I 0 [3.6115 (v 7 ! — [(A: — 32) /32] 2 ) 
/ 0 [3.6115] 


0 < k < 64 


0 


otherwise. 


The impulse response of the FIR filter is then given by h [Ai] = /r n p [/c ] w^aiser [^] - 
The magnitude response of the FIR filter is plotted in Fig. 15.11 using a dB 
scale. 


15.2 Design of highpass filters using windowing 


The windowing method is not restricted to design of lowpass FIR filters; it 
can be generalized to design other types of FIR filters. Section 15.2 considers 
highpass FIR filters, and Sections 15.3 and 15.4 extend the windowing method 
to bandpass and bandstop FIR filters, respectively. 

The transfer function of an ideal highpass filter was defined in Section 14.1 .2, 
and is reproduced here for convenience: 

f 0 \q\ < n c 

ffihp(tf) = (15.23) 

[ 1 f? c < |f?| < it. 

It was shown in Section 14.1.2 that the impulse response of a highpass filter 
can be related to the impulse response of a lowpass filter with the same cut-off 
frequency, it is given by Eqs. (14.3a) and (14.3b). As shown in Table 14.1, the 
impulse response of the ideal highpass filter with a normalized cut-off frequency 
l? n is given by 


h± p [k] = <5[Ar] — Q n sinc[12 n A:]. 


(15.24) 
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Fig. 15.12. Desired 
specifications of a highpass filter. 


\H hv (£2)\ 



The filter with this impulse response is non-causal and hence non-realizable. By 
applying a delay m, the impulse response of an ideal highpass filter is obtained: 

/z ihp [A:] = S [k — m] — I7 n sinc[l7 n (£ — m)]. (15.25) 

Given the impulse response of an ideal highpass filter, we can use the windowing 
method to design a highpass FIR filter. The specifications for the highpass FIR 
filter are illustrated in Fig. 15.12 and are given by 

stop band (0 < 17 < 17 S ) 0 < | // hp (i7)| < <5 S ; 

pass band (17 p < 17 < n) (1 — <5 P ) < |//h p (l7)| < (1 + <5 p ). 

The steps involved in the design of a highpass FIR filter are given in the fol- 
lowing. 

Step 1 Calculate the normalized cut-off frequency I7 n of the filter: 

cut-off frequency 17 C = 0.5 (l7 p + 17 S ) ; 

normalized cut-off frequency I7 n = Q c /tx. 

Step 2 Determine the expression for the impulse response of an ideal highpass 
filter: 


h ihp [k] = S[k - m] - I7 n sin[l7 n (£ - m)], (15.26) 

where 17 C = 7 r.C n and m = (N — l)/2, where N is the length of the FIR filter. 

Step 3 Calculate the minimum attenuation A on a dB scale using A = min(d p , 

S s ). 


Step 4 Calculate the normalized transition band Al7 n for the FIR filter: 


transition BW 
normalized transition BW 


Al7 c = (C p - C s ); 
Al7 n = A17 c /7T. 
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Step 5 Design an appropriate window with parameters A and Af? n using the 
procedures mentioned in Section 15.1.3 or Section 15.1.5. Denote this window 
by w[k]. 


Step 6 Derive the impulse response of the FIR filter: 


hh P [k] = h ibp [k]w[k]. 


(15.27) 


We now derive the condition for the gain \H(tc)\ to be equal to one. Substituting 
fi — jt in the DTFT I HQ), we obtain 


H{n)= 2>[*]e-j*" 


N-\ N—\ 


J2 h[k\ — J2 /! W- 

k= 0,2,... *=1,3,--- 


(15.28) 


In other words, the difference between the sum of the even-numbered samples 
of h[k] and the sum of the odd-numbered samples of li[k] should equal one. If 
not, we calculate the normalized impulse response h' hp [k] = h hp [k]/H(7T). 


Step 7 Confirm that the impulse response /? [£] satisfies the initial specifications 
by plotting the magnitude spectrum | H\ V (Q) | of the FIR filter obtained in step 6. 


We observe that the above algorithm is similar to the design of a lowpass filter, 
except that the impulse response of the ideal lowpass filter is replaced by the 
impulse response of the ideal highpass filter. Example 15.5 uses the above 
algorithm to design a highpass FIR filter using the Kaiser window. 


Example 15.5 

Design a highpass FIR filter, using the Kaiser window, with the following 
specifications: 

(i) pass-band edge frequency Q p = 0.5j r radians/s; 

(ii) stop-band edge frequency l? s = 0.125 jt radians/s; 

(iii) pass-band ripple 201og 10 (l + <5 p ) < 0.01 dB; 

(iv) stop-band attenuation — 201og 10 (<5 s ) > 60 dB. 

Plot the frequency characteristics of the designed filter. 

Solution 

The cut-off frequency Q c of the filter is given by Q c = 0.5(0. 1257T + 0.5jr ) = 
0.31257T. The normalized cut-off frequency Q n of the filter is O c /n = 0.3125. 
The impulse response of the ideal high pass filter with a cut-off frequency of 
0.3125 is given by 

/ !ihp [^] = 8[k - m] - 0.3125 sinc(0.3125(£ - m)). (15.29) 

To determine the minimum attenuation A, we calculate <5 p and 5 S . Since 
201og 10 (l +<$ p ) <= 0.01 dB, the pass-band ripple <5 p should be less than 
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Fig. 15.13. Magnitude response 
of the highpass FIR filter 
designed in Example 15.5. 


201og 10 |//(fl)| 



IqO- 01/20 — l = 0.0012, while S s should be less than 1(T 60 / 20 - 1 = 0.001. The 
minimum attenuation A is therefore given by A = min(0.0012, 0.001) = 0.001, 
or 60 dB. 

The shape parameter is evaluated from Eq. (15.20) as follows: 

P = 0.1 102(A - 8.7) = 5.6533. 


The transition band Af? c for the FIR filter is i7 p — Sl s = 0.3757T. The nor- 
malized transition band Al7 n is therefore given by Af/ c /jr = 0.375. Using 
A12 n = 0.375, the length N of the Kaiser window is given by 


N > 


60 - 7.95 
2.285tt x 0.375 


19.3354. 


Rounding off to the higher closest odd number, we obtain N = 21. 
The expression for the Kaiser window is given by 


It 7 kaiser [^] — 


Iq [5.6533 (v/l - [(*- 10) /10] 2 ) 
7 0 [5.6533] 

0 


0 < k < 20 
otherwise. 


(15.30) 


The impulse response of the highpass FIR filter is given by 


/lhp[^] — h jhp |T| VV kaiser ] , 

where liihp[k] is specified in Eq. (15.29) with m = 10 and WkaiserOT is given in 
Eq. (15.30). The filter gain at ft = n is given by 

N-\ N - 1 

H hp (7t)= h bv [k]~ J2 *hp[*] = 1-0002. 

k= 0,2,... i=l,3,... 

As H{n) ~ 1, the coefficients of h[k\ need not be normalized. 

The magnitude response of the highpass FIR filter is plotted in Fig. 15.13, 
which verifies that the initial specifications of the filter are satisfied. 


In Example 15.5 we designed a highpass FIR filter directly from the given spec- 
ifications. An alternative procedure to design a highpass FIR filter is to exploit 
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Fig. 15.14. Desired 
specifications of a bandpass 
filter. 


|tfbp(<2)l 



Eq. (14.2b) and implement Hi p (12) instead. Based on the frequency character- 
istics of the highpass FIR filter illustrated in Fig. 15.12, the specifications of 
the //ip(12) in Eq. (14.2b) are given by 

pass band (0 < 12 < 12 S ) (1 — <5 S ) < |//i p (l2)| < (1 + <5 S ); 

stop band (12 p < 12 < jt) 0 < | //i p ( 12) | < <5 p . 

The impulse response of the lowpass FIR filter h\ p [£] is then transformed to the 
impulse response h^ p [k] of the highpass FIR filter using the following equation: 

hh P [k] — S[k - m] - h\ p [k]. 


15.3 Design of bandpass filters using windowing 


The design specifications for bandpass filters are specified in Fig. 15.14 and are 
given by 

stop band I (0 < 12 < l2 s i ) 0 < |//(12)| < <5 s i ; 

stop band II (12 S 2 < 12 < jt) 0 < |//(12)| < S s 2 \ 

pass band (I2 p i < 12 < 12 P 2) (1 — 5 p ) < \H{fi)\ < (1 + S p ), 

where we assume that the values of ripples <5 s i and <5 S 2 allowed in the two stop 

bands are different. The algorithm used to design a bandpass FIR filter using 
windowing is similar to the design for the highpass filter described in Section 
15.2, except that the impulse response of an ideal bandpass filter is used in 
step 2. 

The transfer function of an ideal bandpass filter was defined in Section 14.1.3, 
and is reproduced here for convenience: 




1 l2 c i < |12| < 12 c 2 

0 1 12| < 12 C i and 12 C 2 < |12| < jt. 


(15.31) 
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As shown in Table 14.1, the impulse response of the ideal bandpass filter with 
normalized cut-off frequencies of J2 n i, i ? n 2 (C n 2 > -C n 1 ) is given by 


/hbpOT = f?n 2 sinc[C n 2 k] — f? n i sinc[f2 n ik]. (15.32) 

As the filter with this impulse response is non-causal, we apply a delay of m , 
and the modified impulse response is obtained: 


hn, p [k] = C n2 sinc[f2 n 2(^ — m)] — J? n i sinc[f2 n i(k — m)]. (15.33) 

The steps for designing a bandpass filter using windowing are as follows. 

Step 1 Calculate the two normalized cut-off frequencies f2 n i and <7 n 2 of the 
bandpass filter: 

cut-off frequencies f? c i = 0.5(f2 p i + l? s i) and f ? C 2 = 0.5(i7 p 2 + f2 S 2); 
normalized cut-off frequencies l? n i = and Q n 2 = ^ci/n- 

Step 2 Determine the impulse response of the ideal bandpass filter by substi- 
tuting the values of T2 n i and i? n2 in Eq. (15.33). 

Step 3 Calculate the minimum attenuation A on a dB scale using A = min(.5 p , 

*.l, ^s2)- 

Step 4 Calculate the normalized transition bandwidth A Q n for the FIR filter: 

transitional BW Af? c i = (f? p i — T2 s i ) and Af7 C 2 = (T2 S 2 — C p 2 ); 
normalized transition BW Af? n = min (AC c 2 - Af2 c i) /tt. 

Step 5 Design an appropriate window with parameters A and A J 7 n using the 
procedures mentioned in Section 15.1.3 or Section 15.1.5. Denote this window 
by w[k~\. 

Step 6 Derive the impulse response of the FIR filter: 

h hv [k] = h ibp [k]w[k]. (15.34) 

Step 7 Confirm that the impulse response hb p [k] satisfies the initial specifica- 
tions by plotting the magnitude spectrum |//t, p (C)| of the FIR filter obtained in 
step 6. 

Example 15.6 illustrates the working of the above algorithm by designing a 
bandpass FIR filter using the Kaiser window. 
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Example 15.6 

Design a bandpass FIR filter with the following specifications: 

(i) pass-band edge frequencies, I2 pl = 0.3757T and l? p2 = 0.5 jt radians/s; 

(ii) stop-band edge frequencies, I2 sl = 0.257T and £1^2 — 0.6257T radians/s; 

(iii) stop-band attenuations, <$ s i > 50 dB and S s2 > 50 dB. 

Plot the gain-frequency characteristics of the designed bandpass filter. 


Solution 

The cut-off frequencies of the bandpass filter are given by 
£2 c i = 0.5 (0.25jt + 0.375tt) = 0.3125:r 

and 

f? c2 = 0.5 (0.57T + 0.625:r) = 0.56257T. 


The normalized cut-off frequencies are given by I2 nl = fi c \/n = 0.3125 and 
i? n2 = 17 c 2 /7T = 0.5625. The impulse response of an ideal bandpass filter is 
given by 


h ibp [k] = 0.5625 sine [0.5625 (A: - m)] - 0.3125 sinc[0.3 125(/t - m)]. 

(15.35) 

Since only the stop-band attenuations are specified, and these are both equal to 
50 dB, the minimum attenuation A = 50 dB. 

The shape parameter f J > of the Kaiser window is computed to be 

P = 0.1102(50- 8.7) = 4.5513. 

The transition bands A <7 C | and A12 c2 for the bandpass FIR filter are given by 


and 


Af? c i = 0.375 jt — 0.25 n = 0.1257T 


A1? c2 = 0.625^" — 0.5:r = 0.1257T, 


which lead to the normalized transition BW of Af? n = 0.125. 
The length N of the Kaiser window is given by 


N > 


50-7.95 
2.285;r x 0.125 


46.8619. 


Rounded to the closest higher odd number, N = 47, and the value of m in Eq. 
(15.35) is 23. The expression for the Kaiser window is as follows: 


W kaiser [^] — 


/o [4.55 13 (Vl - [(it - 23)/23] 2 ) 
/ 0 [4.55 13] 

0 


0 < A: < 46 (15.36) 

otherwise. 
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Fig. 15.15. Magnitude response 
of the bandpass FIR filter 
designed in Example 15.6. 


201og 10 |//(i2)| 



The impulse response of the bandpass FIR filter is given by 

^bp[^] — h ibpOTw kaiser [^]- 

where liib P [k] is specified in Eq. (15.35) with m = 23 and WkaiserOT is specified 
inEq. (15.36). 

The magnitude spectrum of the bandpass FIR filter is plotted in Fig. 15.15. 
It is observed that the bandpass filter satisfies the design specifications. 

In Example 15.6, we designed a bandpass FIR filter directly. As for the 
highpass FIR filter, an alternative procedure to design a bandpass FIR filter 
is to exploit Eq. (14.4e) and implement two lowpass FIR filters with impulse 
responses H\ p \(k ) and H\ p 2 (k). The specifications for the two lowpass filters 
should be carefully derived such that the pass- and stop-band ripples of the 
combined system are limited to values allowed in the original bandpass filter’s 
specifications. 


15.4 Design of a bandstop filter using windowing 


As illustrated in Fig. 15.16, the design specifications for a bandstop filter are 
given by 


pass band I (0 < ft < l? p i) 
pass band II (l? p 2 < ft < tt) 
stop band (f? s i < ft < ft s2 ) 


(i - 5 P i) < |tf bs (f2)i <(i + a pl ); 
(1 - <S p2 ) < \H bs (ft)\ < (1 + <5 p2 ); 
0 < |// bs (T2)| < S s . 


The steps involved in the design of a bandpass FIR filter using windowing are 
similar to those specified for the bandpass filter in Section 15.3. 

The transfer function of an ideal bandstop filter was defined in Section 14.1 .4, 
and is reproduced here for convenience: 


// ibs (f?) = 


0 ft cl < \ ft\ < ft c2 

1 |f?| < ft c \ and f 2 C 2 < |J7| < tt, 


(15.37) 
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Fig. 15.16. Desired 
specifications of a bandstop 
filter. 


|tfbs(*2)l 



As shown in Table 14.1, the impulse response of the ideal bandstop filter with 
normalized cut-off frequencies of i? n | , i7 n 2 (J?n 2 > f2 n ) is given by 

hit, s [k] — <5[£] — fi n 2 sinc[f7 n 2^] + l? n l sinc[f? n iA:]. (15.38) 

By applying a delay m, the modified impulse response of an ideal bandpass 
filter is obtained: 


/; ibs [£] = 8[k — m ] — f ? n 2 sinc[f? n 2 (A: — m )] + f? nI sinc[i2 nl (£ — m)]. 

(15.39) 

In the following example, we illustrate the steps involved in designing a practical 
bandstop filter using the windowing method. 

Example 15.7 

Design a bandstop FIR filter, using a Kaiser window, with the following speci- 
fications: 

(i) pass-band edge frequencies, f2 p i = 0.25? r and f2 p 2 = 0.625tt radians/s; 

(ii) stop-band edge frequencies, T2 s i = 0.375 jt and 12 S 2 = 0.57T radians/s; 

(iii) stop-band attenuations, <5 si > 50 dB and <5 S 2 > 50 dB. 


Solution 

The cut-off frequencies of the bandpass filter are given by 


f? c i = 0.5 (0.257T + 0.375 jt) = 0.3125tt 

and 

n c2 = 0.5 (0.5jt + 0.625nr) = 0.5625^-. 


The normalized cut-off frequencies are given by f? n i = 0.3125 and f ? n 2 = 
0.5625. The impulse response of an ideal bandpass filter is given by 


/i ibs [Jt] = 8[k - m] - 0.5625 sinc[0.5625(fc - m)] 
+ 0.3125 sinc[0.3125(A: — m)\. 


(15.40) 
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The minimum attenuation A — 50 dB. Therefore, The shape parameter ft of 
the Kaiser window is computed as 

P — 0.1 102(50 — 8.7) = 4.5513. 

The transition bands A <? c i and Af2 C 2 for the bandpass FIR filter are given by 

Ai? c i = (0.375;r — 0.257r) = 0.1257T and Ai7 C 2 
= (0.625:r - 0.5 tt) = 0.125tt, 


which leads to the normalized transition BW of Af? n = 0.125. 
The length N of the Kaiser window is given by 

50 - 7.95 


N > 


= 46.8619. 


2.285tt x 0.125 

Rounded to the closest higher odd number, N — 47, and the value of m in Eq. 
(15.40) is 23. 

The expression for the Kaiser window is as follows: 

' /„ [4.55 13 (Vl - [(£ - 23) /23] 2 ) 


W kaiser [k] — 


/ 0 [4.55 13] 


0 


0 < k < 46 (15 . 41) 

otherwise. 


The impulse response of the bandpass FIR filter is given by 

hbs[k] — h ibs [^] ^kaiser [^] > 


where hib S [k\ is specified in Eq. (15.40) with m = 23 and w^aisert^] is as shown 
inEq. (15.41). 

The magnitude response of the bandstop FIR filter is plotted in Fig. 15.17. It 
is observed that the bandstop filter satisfies the design specifications. 


In the above example, a bandstop FIR filter was designed directly. As for the 
highpass and bandpass FIR filters, an alternative design procedure (see Eq. 14.6) 
is to express the transfer function of a bandstop FIR filter in terms of the transfer 
functions of two lowpass filters as follows: 


hibAk] = S[k - m] - /iiipi[^]| fic =fi c2 + h\ V 2 [k]\n c =n cl - (15.42) 

The specifications for these two lowpass filters are derived from the given 
design specifications of the bandpass filter. As for bandpass FIR filters, the 
specifications of the lowpass filters should be carefully assigned such that the 
pass- and stop-band ripples of the combined system satisfy the original bandstop 
filter’s specifications. 


15.5 Optimal FIR filters 


Designing an FIR filter using the windowing approach is simple but suffers 
from one severe limitation. The minimum attenuation obtained in the stop 
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Fig. 15.17. Magnitude response 
of the bandstop FIR filter 
designed in Example 15.7. 


20 log 10 |77(i2) 



band of the FIR filter is fixed for the elementary window types covered in 
Section 15.1.2. The Kaiser window, introduced in Section 15.1.4, provides some 
flexibility in controlling the stop-band attenuation by introducing an additional 
design parameter /3. However, there is no guarantee that the FIR filter, designed 
with either the elementary windows or the Kaiser window, is optimal. In this 
section, we introduce a computational optimization procedure for the design 
of FIR filters. The procedure is commonly referred to as the Parks-McClellan 
algorithm, which iteratively minimizes the absolute value of the error: 


e(12) = W(f2) [H d (f2) - H(Q)], (15.42) 


where H d (Q) is the transfer function of the desired or ideal filter, whose fre- 
quency characteristics are to be approximated, H{fi) is the transfer function 
of the approximated FIR filter, and W{Q) is a weighting function introduced 
to emphasize the relative importance of various frequency components of the 
filter. For a lowpass filter, for example, a logical way to select the values of the 
weighting function is to set 


lowpass filter 


W(f2) = 


1/<5 P 

0 

,1/S s 


0 < fi < J2 P 
I2 p < 17 < l? s 
n s < n < 7t. 


(15.43) 


Equation (15.43) implies that if the condition for the pass-band ripple is more 
stringent (i.e. smaller) than the condition for the stop-band ripple, the weighting 
function allocates a higher weight to the pass band than to the stop band, and 
vice versa. Zero weight is associated with the transition band, which means 
that the weighting function does not care about the characteristics of the FIR 
filter in the transition band as long as the filter’s gain changes steadily between 
the pass and stop bands. Scaling Eq. (15.43) with <5 S , the normalized weighting 
function is given by 

' s s /s p o<n<n p 

0 n v < n < q s 

1 fi s < fl < 7T . 


lowpass filter 


W(f2) = 


(15.44) 
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The weighting function for highpass, bandpass, and bandstop filters can be 
derived in a similar fashion. Given a weighting function, the Parks-McClellan 
algorithm seeks to solve the following optimization problem: 


min max 
{h[k]} \_ne S 




(15.45) 


where S is defined as a set of discrete frequencies chosen within the pass and 
stop bands. For a lowpass filter, the set of frequencies that can be included in S 
should lie in the following range: 


lowpass filter S — [0 < 1? < T2 p ] U [l? s < fl < n] (15.46) 


Similarly, the sets S of discrete frequencies are carefully selected over the pass 
and stop bands for other types of filters. 

Because Eq. (15.45) minimizes a cost function, which is the maximum of the 
error g(i7), Eq. (15.45) is also referred to as the minimax optimization problem. 
The goal in solving Eq. (15.45) is to determine the set of coefficients for the 
impulse response h[k] of the optimal FIR filter of length N. 

It was shown in Proposition 14.1 (see Section 14.3.1) that if the filter coe- 
fficients of an FIR filter are symmetric or anti-symmetric, the phase response 
of the filter is a linear function of frequency, and the transfer function can be 
expressed as follows: 


H{Q) = G{Q)^- aS1) , (15.47) 


w lie re a = (N — l)/2, ft is a constant, and G(O) is a real- valued function, 'fable 
14.2 shows the values of ft and G(i2) for four types of linear-phase FIR filters. 

The Parks-McClellan algorithm exploits Proposition 14.1 to solve the mini- 
max optimization problem, as explained in the following. For various types of 
linear-phase FIR filter, G(J2) is a summation of a finite number of sinusoidal 
terms of the form cos (ilk) or sin (ilk), which themselves can be expressed as 
polynomials of cos(l7). For example, cos (ilk) can be expressed as a kth-order 
polynomial of cos(i2), which, for k = 2 and 3, can be expressed as follows: 

cos (21?) = 2cos 2 (i2 — 1); 

cos (31?) = 4cos 3 (12) — cos(12). 

It is observed from Table 14.2 that the function G(12) can be expressed as a sum 
of several higher-order terms cos(12k) or sin(l?k). Therefore, G(12) can also be 
expressed as a polynomial of cos(12). It can be shown that the error function e(12) 
in Eq. (15.42), corresponding to linear-phase FIR filters, can also be expressed 
as a polynomial of cos(12). Parks and McClellan applied the alternation theorem 
from the theory of polynomial approximation to solve the minimax optimization 
problem. For convenience, we first express the alternation theorem in the context 
of polynomial approximation, and later we show its adaptation to the minimax 
optimization problem. 
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15.5.1 Alternation theorem 

Let S be a compact subset on the real axis x and let D(x) be a desired function 
of x which is continuous on S. Let D(x) be approximated by P(x), an Lth-order 
polynomial of x, which is given by 

L 

P(x) = ^2 c m x m . (15.48a) 

m= 0 

Define the approximation error s(x) and the amplitude of the maximum error 
value e max on S as follows: 


e(x) = W(x)[D(x) - P(x)] : (15.48b) 

e m ax = arg max |e(x)|. (15.48c) 

xeS 


A necessary and sufficient condition for P(x) to be the unique Lth-order poly- 
nomial minimizing e max is that s(x) exhibits at least L + 2 alternations. In other 
words, there must exist L + 2 values of x, {x A < xo <■■■ xl+ 2 } e S such that 
£(Xtn) — ^CLh + i) — i^rnax ■ 

Note that the minimax optimization problem for optimal filter design fits 
very well in the framework of the alternation theorem. In the filter design 
problem, S is the subset of DT frequencies, D(x) is the desired filter response, 
P(x) is the approximated filter response, and e max is the maximum deviation 
between the desired and approximated filter response. Therefore, the FIR filters 
obtained using minimax optimization is also expected to exhibit alternations in 
its frequency response. However, note that G(17) is a polynomial of cos(L) and 
not of ft. This issue can be addressed by using the mapping functions = cos (ft). 
In this case, the frequency space ft = |0, it] can be mapped tox = [—1, l],and 
the optimization problem can be reformulated around x to calculate the optimal 
filter coefficients. It can be shown that the alternation in the frequency response 
of the optimal filters is still applicable. 

Based on the above discussion, the alternation theorem can be restated for 
the minimax optimization problem as follows. Consider the following minimax 
optimization problem: 


{h[k\. 0< k <{N- 1)} 


max |e(f?)| 
ties 


s(ft) = W(ft ) 


H a (G) - G(f2)e- jfl(iV - 1/2) e^ 


(15.49a) 


(15.49b) 


H(ST) 


where S is a set of discrete extremal frequencies chosen within the pass and stop 
bands, W(ft) is a positive weighting function. Iff ft) is the transfer function of 
the ideal filter with a unity gain within the pass band and a zero gain within the 
stop band, and G(ft) is a polynomial of cos(.C) with degree L , which is uniquely 
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specified by the impulse response h [fcj. Let e max max denote the maximum value 
of the error |e(17)|. The polynomial G(1 7), which best approximates H&(Q) 
(i.e. minimizes £ max ), produces the error function £(17) that must satisfy the 
following property. There should be at least L + 2 discrete frequencies { 17 \ < 
< • • • < Ql+ 2 } e S at which the maximum and minimum peak values of 
the error alternate, i.e. £(l7 m+ i) = — £(17,„) = £ max . 

Before presenting some examples of the application of the alternation theo- 
rem, we briefly comment on the degree L of the error function £(17) in the FIR 
filters. The value of L is determined by evaluating the highest power of cos(l7) 
in the G(Q) function of the filters. For the four types of FIR filters with length 
N, the value of L is specified as follows: 

type I FIR filters 
type II FIR filters 
type III FIR filters 
type IV FIR filters 

The alternation theorem states that the minimum number of alternations for the 
optimal FIR filter should be at least L + 2. The actual number of alternations 
in an optimal FIR may, however, exceed the minimum number specified by the 
alternation theorem. An optimally designed lowpass or highpass filter can have 
up to L + 3 alternations, while an optimal bandpass or bandstop filter can have 
up to L + 5 alternations. 

Example 15.8 

The magnitude spectra of two lowpass FIR filters with lengths N = 13 and 
20 are, respectively, shown in Figs. 15.18(a) and (b), where the filter gain 
within the pass and stop bands is enclosed within a frame box. Determine if the 
two filters satisfy the alternation theorem. 

Solution 

Figure 15.18(a) shows the frequency response of a type I FIR filter with 
length N — 13. The degree L of cos(l7) in the polynomial £(17) is given 
by L = (13 — l)/2 = 6. Based on the alternation theorem, there should be at 
least L + 2 = 8 alternations in polynomial £(17). Note that the absolute value 
of error |fi(l7)| is the difference |//(17) — /^(l 7)|, where //d(l7) has a unity gain 
within the pass band and zero gain within the stop band. Therefore, counting the 
number of alternations in £(17) is the same as counting the number of alterna- 
tions in H(S 7) with respect to the pass- and stop-band ripples. From Fig. 15.18 
we observe that there are indeed eight alternations (shown by x symbols) in 
One of these alternations occurs at the pass-band edge frequency 17 P , 


L = 
L = 
L = 
L 


X I 

2 ’ 
N -2_ 
2 ’ 
N - 3 

2 ’ 
N -2 
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Fig. 15.18. Magnitude spectrum 
of lowpass FIR filters, (a) Type I 
FIR filter of length /V = 13. 

(b) Type II FIR filter of length 
N = 20. 


and two of these alternations occur at the stop-band edge frequencies f? s and 
7 r. In other words, Fig. 15.18(a) satisfies the alternation theorem. 

Figure 15.18(b) shows the frequency response of a type II FIR filter with 
length N = 20. The degree L of cos(l?) in polynomial e(T2) is given by 
L = (20 — 2)/2 = 9. Based on the alternation theorem, there should be at least 
L + 2 = 11 alternations in polynomial s(S7). In Fig. 15.18(b), we observe 12 
alternations in //(<7), which exceed the minimum required number of alterna- 
tions. Therefore, Fig. 15.18(b) satisfies the alternation theorem. 


15.5.2 Parks-McClellan algorithm 

In this section we present steps of the Parks-McClellan algorithm for designing 
optimal filters. In this discussion, we will consider only type I filters. Algorithms 
for other types of filters can be obtained in the same manner. To derive the 
Parks-McClellan algorithm, the approximated error function in Eq. (15.49b) is 
expressed as follows: 


e(f2) 

G(G) + — — « H a (Q). 

W{(2) 


(15.50) 


For type I filters, we obtain G(Q) from Table 14.2 as follows: 


G(H) = h 


N - T 


(2V— 1)/2 

2 E h 

k = 1 


N - 1 


cos(f2k). 


Since we are interested in calculating (N — l)/2 + 1, or L + 1, coefficients 
of h[k] in G(f2) and the value of the maximum error £ max , we pick L + 2 
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discrete frequencies {Hi < ih < ■ ■ ■ < H L+2 ] e S, and solve Eq. (15.50) at the 
selected frequencies. Assuming that the selected frequencies are the extremal 
frequencies at which the maximum error changes between its peak value of 
±e max , Eq. (15.50) reduces to 

G{Q m ) + 77777TT ( — 1 ) m £ max = H A (Q m ). (15.51) 

W((2 m ) 

for 1 < m < (L + 2). The resulting set of (L + 2) simultaneous equations is as 
follows: 


1 COS (12i) • 

1 cos (lA) • 

•• cos — \/W(f2i) 

■■ COS (Ll?2) — 1 / VK ( T?2 ) 


r " 

Zh[2jL-l\ 


1 

aa a? 

1 

1 COS {Ql+i) • 

•• cos(Lf2 i+1 ) (-1 ) t+1 /W(f? L+1 ) 


2/7 [0] 


H d (n L+i ) 

. 1 cos (H l+2 ) • 

•• cos(Z,G L+2 ) (-1 ) l+ 2 /W(H l+2 ). 


£max 


_h a 


A(cos(&l?)) 

(15.52) 


Once the extremal frequencies {l?i < < • • • < Ql+ 2 } are known, Eq. 

(15.52) can be used to solve for the coefficients of the FIR filter. The extremal 
frequencies are computed using the Remez algorithm, which is based on Eq. 
(15.52) (though it does not solve the simultaneous equations explicitly) and 
consists of the following steps. 

Initialization: pick {l?i < ft 2 < ■ • - < Hl+i] e S evenly over the pass and 
stop bands. 

Given: transfer function H&((7) of the ideal filter and the weighting function 
W{H). 


Step 1 Solve Eq. (15.52) to calculate £ max . To compute £ max , we do not need to 
solve the complete set of simultaneous equations given in Eq. (15.52). Instead 
the following expression, obtained from Eq. (15.52) is solved: 


£max 


(-D L+3 

| A (cos ( kf}))\ 


1 cos(12i) cos(Ll?i) Hi(fi\) 

1 cos (.Q 2 ) cos(Ll? 2 ) Hi (12 2 ) 


1 cos (J?l+i) ••• cos (LQl+i) Hi (J?L+l) 

1 cos (f? L+2 ) • • • cos (Ln L+2 ) Hi (H l+2 ) 

(15.53) 


where | A(-)| denotes the determinant of the matrix A(-). 


Step 2 Substituting the value of £ max determined in step 1 , compute the values 
of G(f? m ) at discrete frequencies < fi 2 < ■ ■ ■ < H L+2 } using Eq. (15.51). 
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Step 3 Using the values of G(12,„) computed in step 2, sketch a line plot of 
G(J2) as a function of Q by interpolating intermediate values of G(i2). Generally, 
G(12) is interpolated over a large grid of discrete frequencies within S. 

Step 4 Using the line plot of G(12) obtained in step 3, sketch the line plot of 
e(l 7) as a function of 12 using the following expression: 

£(12) = W(Q)[H a {Q) - GUT)], 

derived from Eq. (15.50). 

Step 5 Update the L + 2 extremal frequencies {12] < t ?2 < ■ ■ ■ < 12/. + 2 } e S 
by determining the L + 2 maxima and minima in £(12) plotted in step 4. 

Step 6 Check if the L + 2 maxima and minima observed in step 5 have the 
same value. If they do, then the alternation theorem is satisfied and the updated 
frequencies {l?! <12 2 < ■ • • < I2 i+ 2j- can be used to solve Eq. (15.52) for the 
filter coefficients. If not, then go back to step 1 and repeat steps 1-6. 

The Parks-McClellan algorithm, highlighted in the aforementioned discus- 
sion, designs a lowpass FIR filter. Extension to other types of FIR filters is 
straightforward, provided that the required filter can be expressed in terms of 
a lowpass filter. Equation (15.24) illustrates how the design of a highpass filter 
can be transformed to the design of a lowpass filter. Similarly, Eqs. (15.32) and 
(15.38), respectively, provide transformations for bandpass and bandstop filters. 
Once the specifications of the required filter are expressed in terms of a low- 
pass filter, the impulse response of the optimal lowpass FIR filter is computed 
using the Parks-McClellan algorithm. The impulse response of the required FIR 
filter is then calculated from the impulse response of the optimal lowpass FIR 
filter. 


15.6 Matlab examples 


The design algorithms covered in this chapter are incorporated as library func- 
tions in most signal processing software packages. In this section, we introduce 
several M-files available in Matlab for the design of FIR filters. In par- 
ticular, we cover rectwin, bartlett, harm, hamming, and blackman 
functions, which are used to implement the elementary windows covered in 
Section 15.1. In addition, we consider the f irl function to derive the impulse 
response of the FIR filter. The kaiser function used to design FIR filters 
using the Kaiser window and the f i rpm function used to implement the Parks- 
McClellan algorithm are also presented in this section. In each case, we write 
the Matlab code for the design of the FIR filter specified in Example 15.2. 
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For convenience, the specifications of the lowpass filter in Example 15.2 are 
given by 

pass-band edge frequency (a> p ) = 3ic kradians/s, 
stop-band edge frequency (<u s ) = Arc kradians/s, 
maximum allowable pass-band ripple — 201og 10 (<5 p ) = 25 dB, 
i.e. «5 P = 0.0562, 

minimum stop-band attenuation — 201og 10 (<5 s ) = 50 dB, 
i.e. <5 S = 0.0032, 

sampling frequency (/o) = 8 ksamples/s. 


Example 15.9 

Design the lowpass FIR filter considered in Example 15.2 using the rectangular, 
Bartlett, Hanning, Hamming, and Blackman windows. Sketch and compare the 
magnitude response of the resulting FIR filters. 

Solution 

As shown in Example 15.2, the values of the normalized cut-off frequency 
and the normalized transition bandwidth for the lowpass filter are given by 
Q n = 0.4375 and AJ7„ = 0.125, respectively. 

Since the minimum stop-band attenuation is 50 dB, only the Hamming and 
Blackman windows may be used for the filter design. The value of length N of 
the FIR filters for the two windows is given by 

Hamming window 6.6 / N = 0.1250 => N — 6.6/0.125 = 52.8; 

Blackman window 11 /N = 0.1250 => N = 11/0.125 = 88. 

Matlab provides the f irl function to derive the impulse response of the 
FIR filter. The syntax for the f irl function is given by 

fir_coeff. = firl(order, norm_cut_of f , type, window) ; 

where the input argument order denotes the order of the FIR filter. For 
an FIR filter of length N, the order is given by N - 1. The input argument 
norm_cut_of f specifies the normalized cut-off frequency of the FIR filter. 
Its value should lie between zero and one. The input argument type specifies 
the type of the FIR filter. Two possible choices for type are ' low' for the 
lowpass FIR filter and 'high' for the highpass FIR filter. Finally, the input 
argument window accepts coefficients w\k ] of the window type being used 
in the FIR filter design. Any of the elementary windows covered in Section 
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15.1 can be used by naming the appropriate window function. The syntaxes for 
various types of length - N window functions are as follows: 


>> win_coeff 
>> win_coeff 
>> win_coeff 
>> win_coeff 
>> win_coeff 


rectwin (N) ; 
bartlett (N) 
hann (N) ; 
hamming (N) ; 
blackman (N) 


% rectangular window 
% bartlett window 
% hanning window 
% hamming window 
% blackman window 


For Example 15.2, the M ATL AB code for the design of the FIR filter using the 
Hamming window is given by 

% lowpass filter design using Hamming window 

>> wn = 0.4375; % Normalized cut-off 

% frequency 

>> N = 53; % Hamming Window 

>> h_hamm = firl(N-l,wn, ' low' , hamming (N) ) ; 

% Impulse response of 
% the LPF 

>> w = 0 : 0 . 001*pi :pi ; % discrete frequencies 

% for response 

>> H_hamm = f reqz (h_hamm, 1 , w) ; % transfer function 

>> plot (w, 20*logl0 (abs (H_hamm) ) ) ; % magnitude response 
>> axis([0 pi -120 20]); % set axis 

>> title ('FIR filter using Hamming window') 

>> grid on 

The magnitude response of the FIR filter obtained with the Hamming window 
is shown in Fig. 15.19(a). Note that the magnitude response satisfies the filter 
specifications. 

The Matlab code for the design of the FIR filter using the Blackman 
window is similar, except for a few minor changes, which are shown below. 

% lowpass filter design using Blackman window 
>> wn = 0.4375; % Normalized cut-off 

% frequency 

>> N = 88; % Blackman Window size 

>> h_black = firl(N-l,wn, ' low' , blackman (N) ) ; 

% Impulse response of 
% the LPF 

>> w = 0 : 0 . 001*pi :pi ; % discrete frequencies 

% for response 


703 


15 FIR filter design 



(a) 


FIR filter using Blackman window 
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Fig. 15.19. FIR filter design for 
Example 15.9 using Matlab. 

(a) Hamming window 

(b) Blackman window. 


» H_black = freqz (h_black, 1 , w) ; % transfer function 

» plot (w, 20*logl0 (abs (Hiblack) ) ) ; % magnitude response 
» axis([0 pi -120 20]); % set axis 

» title ('FIR filter using Blackman window'); 

>> grid on 


The magnitude response of the FIR filter obtained with the Blackman window is 
shown in Fig. 15.19(b). On comparing with Fig. 15.19(a), we note that the stop- 
band attenuation in Fig. 15.19(b) is higher. The improvement in the stop-band 
attenuation is the result of the shape of the Blackman window. 

Although the above example uses only the Hamming and Blackman windows, 
any of the elementary windows covered in Section 15.1 can be used by speci- 
fying the appropriate window coefficients in the f irl function. 


Example 15.10 

Design the lowpass FIR filter considered in Example 15.3 using the Kaiser 
window. Sketch and compare the magnitude response of the resulting FIR filter 
with those of the FIR filters obtained in Example 15.3. 

Solution 

As shown in Example 15.3, the normalized cut-off frequency ft, , = 0.4375 and 
the normalized transition bandwidth Af? n = 0.1250. The design parameters for 
the Kaiser window were calculated as — 4.5513 and N = 47. 

The Matlab code for the design of the FIR filter using the Kaiser window 
is similar to the Matlab code in Example 15.9. The major difference is in the 
f irl instruction, where the window argument is now replaced by the kaiser 
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Fig. 15.20. FIR filter design for 
Example 15.10 with the Kaiser 
window using Matlab. 



function. A Kaiser window of length N and shape parameter ft can be generated 
by the following instruction: 

Win = kaiser (N, beta) 

The Matlab code is given by 

% lowpass filter design using Kaiser window 

>> wn = 0.4375; % Normalized Cutoff 

% frequency 

>> N = 47; % Kaiser Window length 

>> beta = 4.5513; % Kaiser Shape control 

% parameter 

>> h_kaiser = firl(N-l,wn, ' low' , kaiser (N, beta) ) ; 

% Impulse response of 
% the LPF 

>> w = 0:0. 001 *pi :pi ; % discrete frequencies 

% for response 

>> H_kaiser = f reqz (h_kaiser , 1 , w) ; % transfer function 

>> plot (w, 20*logl0 (abs (H_kaiser ) ) ) ; % magnitude response 
>> axis([0 pi -120 20]); % set axis 

>> title ('FIR filter using Kaiser window' ) ; 

>> grid on 

The magnitude response of the FIR filter obtained with the Kaiser window is 
shown in Fig. 15.20. Compared with Figs. 15.19(a) and (b), we note that the 
minimum stop-band attenuation in Fig. 15.20 is exactly 50 dB. Being able to 
provide the exact specified attenuation, the Kaiser window is able to reduce 
the length of the lowpass FIR filter to 47. Among the three filters, the FIR 
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filter obtained from the Kaiser window is therefore the least expensive from the 
implementation perspective. 

For the design of optimal filters, Matlab has incorporated the f irpm func- 
tion, which has the following syntax: 

f ir_coef f icients = firpm(order , range_norm_cut_of f , 
f .response , matrix) ; 

where the input argument order denotes the order of the FIR filter. The second 
input argument rang_norm_cut_of f is a vector that specifies the edges of 
the normalized cut-off frequency of the FIR filter. All elements of this vector 
should have a value between zero and one. For a lowpass filter, the elements of 
the rang_norm_cut_of f vector are given by 

rangjnorm_cut_of f = [0, pass_band_cut_of f , stop_band_cut_of f , 
1 ] ; 

The third input argument f_response specifies the four gains of the FIR 
filter at the four frequencies specified in the rang_norm_cut_of f vector. For 
a lowpass filter, the value of the f .response vector is given by 

f .response =[1, 1, 0, 0] ; 

Finally, the fourth input argument wmatrix specifies the weight matrix. Since 
wmatrix has one entry per band, it is half the length of rang_norm_cut_o f f 
and f .response vectors. 

Example 15.11 illustrates the design of an optimal FIR filter using the f i rpm 
function. 

Example 15.11 

Examples 15.9 and 15.10 designed an FIR filter using rectangular. Ham- 
ming, and Kaiser windows with a given set of design specifications. It was 
shown in Example 15.10 that an FIR filter of length 47, designed using a 
Kaiser window, satisfies the design specifications. Design the optimal FIR filter 
of length 47 using the Parks-McClellan algorithm and compare the magni- 
tude frequency response with that of the FIR filter obtained using the Kaiser 
window. 

Solution 

The values of the normalized pass- and stop-band edge frequencies are given 
by 

normalized pass-band edge frequency f2 p = (3n x 10 3 )/(0.5 x 2n x 8 x 10 3 ) 

= 0.375; 

f2 s = (4 tt x 10 3 )/(0.5 x 2n x 8 x 10 3 ) 

= 0.5. 


normalized stop-band edge frequency 
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Fig. 15.21. Optimal FIR filter 
designed in Example 15.11 using 
Matlab. (a) Optimal FIR filter of 
length /V = 47. (b) FIR filter of 
length N = 47 using the Kaiser 
window. 


The Matlab code for the design of the optimal FIR filter is similar to the 
Matlab code in Example 15.8, except for the use of the f irpm function, 
which replaces the f irl function: 


% optimal lowpass filter design using Parks-McClellan 
% algorithm 

>> sz =47; % Length of FIR filter 

>> rangejnorm_cut_of f = [0, 0.375, 0.5, 1] ; 


% normalized cut-off 
% frequencies 

>> f_response = [1, 1, 0, 0]; % gains at the cut-off 

% frequencies 

>> matrix = [0.0032/0.0562, 1]; % weight matrix 

>> h_optimal = firpm(sz-l, range_norm_cut_of f , f_response, 
matrix) ; % Impulse response of 

% the optimal LPF 
% FIR filter 

>> w = 0 : 0 . 001*pi :pi ; % discrete frequencies 

>> H_optimal = f reqz (h_optimal , 1 , w) ; % transfer function 
>> plot (w, 20*logl0 (abs (H_optimal) ) ) ; % magnitude response 
>> axis([0 pi -120 20]); % set axis 

>> title (' optimal FIR filter'); 

>> grid on 


The magnitude response of the optimal FIR filter obtained from the above code 
is shown in Fig. 15.21(a). Comparing Fig. 15.21(a) with the magnitude response 
of the FIR filter obtained from the Kaiser window shown in Fig. 15.21(b), the 
following differences are noted. 
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Fig. 15 . 22 . Same as Fig. 15.21 ( 1 ) The stop-band ripples in Fig. 1 5 .2 1 (a) have a uniform peak value of roughly 

except the frequency responses 70 dB, which is about 20 dB less than the maximum stop-band ripple 

are plotted on a linear scale. value in Fig 15 . 21 (b). The stop-band attenuation of the optimal FIR fil- 

ter is therefore higher than that for the filter obtained from the Kaiser 
window. 

(2) As illustrated in Fig. 15.22(a), where the magnitude response of the optimal 
FIR filter is plotted on a linear scale, there are noticeable pass-band ripples 
in the magnitude response of the optimal FIR filter. Figure 15.22(b) plots 
the magnitude response of the FIR filter obtained from the Kaiser window, 
where the pass-band ripples are negligible. The improvement in the stop- 
band attenuation of the optimal FIR filter can therefore be attributed to the 
pass-band ripples that the optimal filter has incorporated. The optimal FIR 
filter distributes the distortion between the pass and stop bands. The FIR 
filter obtained from the Kaiser window has most distortion concentrated in 
the stop band, which leads to higher ripples (or lesser attenuation) within 
its stop band. 

(3) Finally, we observe that the transition bands in the two FIR filters are 
roughly of the same width. 

15.7 Summary 


This chapter presented techniques for designing causal FIR filters. The ideal 
frequency-selective filters presented in Chapter 14 are physically unrealizable 
because of strict constraints on the pass- and stop-band gains of the filter and 
also because of a sharp transition between the pass and stop bands. Practi- 
cal implementations of the ideal filters are obtained by allowing acceptable 
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variations (or ripples) within the pass and stop bands. In addition, a transition 
band is included between the pass and stop bands so that the filter gain can drop 
off smoothly. 

Section 15.1 introduced the windowing approach used to design FIR filters 
from the ideal frequency-selective filters. The windowing approach truncates 
the impulse response h [k ] of an ideal filter, with a linear-phase component of 
exp(— ]mO), to a finite length N within the range 0 < k < (N — 1). The value 
of m in the phase component is selected to be (N — 1 )/2 such that the filter 
coefficients in the causal FIR filter are symmetrical with respect to m. Common 
elementary windows used to design FIR filters are the rectangular, Bartlett, 
Hamming, Hanning, and Blackman windows. The selection of type of window 
depends upon the maximum value of the pass- and stop-band ripples. The length 
N of the window is determined from the allowable width of the transition 
band. 

The minimum stop-band attenuation in the FIR filter obtained from the ele- 
mentary windows is fixed. In most cases, the selected window surpasses the 
given specification on the stop-band attenuation and the resulting FIR filter is 
therefore of higher computational complexity than required. Section 15.2 intro- 
duced the Kaiser window, which provides control over the stop-band attenuation 
by including an additional design parameter, referred to as the shape control 
parameter fk. The order of the FIR filter designed by the Kaiser window is sig- 
nificantly smaller than those of the FIR filters obtained using the elementary 
window functions. 

The FIR design techniques covered in Sections 15.1 and 15.2 are applicable to 
all types of frequency-selective filters such as the lowpass, highpass, bandpass, 
and bandstop filters. Common convention, however, is to express the transfer 
functions of the highpass, bandpass, and bandstop filters in terms of the transfer 
function of the lowpass filter. Using the resulting relationships, the design of any 
type of filter can be reduced to the design of one or more lowpass filters. Section 
15.3 covered design techniques for highpass FIR filters. We covered design 
algorithms using the original highpass filter specifications as well as techniques 
that transform the problem of designing a highpass FIR filter to designing 
a lowpass FIR filter. Similarly, Section 15.4 presented design techniques for 
bandpass FIR filters, while Section 15.5 designed bandstop FIR filters. 

The windowing approaches produce a suboptimal design. Section 15.5 intro- 
duced a computational procedure based on the Parks-McClellan algorithm that 
exploits the inherent structure, expressed in Proposition 14.1 for the linear- 
phase FIR filters. The Parks-McClellan algorithm computes the best FIR filter 
of length N that minimizes the maximum absolute difference between the trans- 
fer function II JO) of the ideal filter and the transfer function 11(0) of the cor- 
responding FIR filter. Mathematically, the Parks-McClellan algorithm solves 
the minimax optimization problem, which finds the set of filter coefficients 
that minimizes the maximum error between the desired frequency response and 
the actual frequency response. According to Proposition 14.1, the frequency 


709 


15 FIR filter design 


response of a linear-phase filter can be expressed as a polynomial of cos(17). 
It can also be shown that error £(17) between the desired and actual frequency 
response is also a polynomial of cos(l2). The Parks-McClellan algorithm uses 
the alternation theorem, which provides the following condition for the optimal 
design of H(i 7). 

The transfer function which best approximates H&(Q) in the minimax 

sense, produces an error function £(12) with at least L + 2 discrete extremal 
frequencies {l2i < f ?2 < • • • < C/.+ai e S in £(17) that alternate between the 
maximum and minimum peak values of the error, i.e. £(l? ffl+ i) = — £(17,„) = 
£ max , where £ max is the maximum value of error |£(17)|. 

The Parks-McClellan algorithm is available as a library function in most 
signal processing packages. Section 15.7 covered the firpm function used 
to design optimal FIR filters in Matlab using the Parks-McClellan algo- 
rithm. In addition, we introduced other library functions including rectwin, 
bartlett, harm, hamming, blackman, and kaiser functions used to 
implement the elementary windows covered in Sections 15.1 and 15.2. The 
firl function used to derive the impulse response of an FIR filter is also 
covered. 


Problems 


15.1 The ideal DT differentiator is commonly used to differentiate a CT signal 
directly from its samples. The transfer function of a DT differentiator is 
given by 

H m (C) = ]f2er imn 0 < \n\ < tt . 

Determine the impulse response /idiff[k] of the ideal differentiator. 

15.2 A system with the block schematic shown in Fig. 9. 1 is used to process a 
CT signal with a digital filter. The A/D converter has a sampling rate of 
8000 samples/s. Design the ideal digital filter if the overall transfer func- 
tion of Fig. 9. 1 represents an ideal lowpass filter with a cut-off frequency 
of 2 kHz. Repeat for the sampling rates of 16 000 samples/s and 44 100 
samples/s. 

15.3 Calculate the amplitude of the 5-tap ( N — 5) rectangular, Hanning, Ham- 
ming, and Blackman windows. Sketch the window functions. 

15.4 The specifications for a lowpass filter are given as follows: 

pass-band edge frequency = 0.257T; 
stop-band edge frequency = 0.55 tt; 
minimum stop-band attenuation = 35 dB. 
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Determine which of the elementary windows mentioned in Table 15.2 
would satisfy these specifications. For the permissible choices, deter- 
mine the lengths N of the windows that meet the width requirement for 
the transition band. 

15.5 Repeat Problem 15.4 for the Kaiser window. 

15.6 Determine the impulse response of an ideal discrete-time lowpass filter 
with a cut-off frequency of 17 C = 1 radian/s. Using a rectangular window, 
truncate the length N of the ideal filter to 51. Plot the impulse response 
and amplitude frequency characteristics of the FIR filter. 

15.7 Repeat Problem 15.6 for the Hamming window and compare the result- 
ing FIR filter with the FIR filter obtained from the rectangular window 
in that problem. 

15.8 Design the digital FIR filter, shown as the central block and labeled as 
the DT system in Fig. 9. 1 , if the specifications of the overall system are 
given as follows (the overall CT system is a lowpass filter): 

pass-band edge frequency = 10.025 kHz; 
width of the transition band = 1 kHz; 
minimum stop-band attenuation = 45 dB ; 
sampling rate = 44.1 ksamples/s. 

(a) Determine the possible types of windows that may be used. 

(b) Assuming that the Hamming window is used to design the FIR filter, 
plot the impulse response li[k] of the resulting FIR filter. 

(c) Plot the amplitude-frequency characteristics of the FIR filter on both 
absolute and logarithmic scales. 

15.9 Repeat Problem 15.8 for a Kaiser window. 

15.10 Using the Kaiser window, design a highpass FIR filter based on the 
following specifications: 

pass-band edge frequency = 0.64 tt; 
width of the transition band = 0.37T; 
maximum pass-band ripple < 0.002; 
maximum stop-band ripple < 0.005. 

UseMATLAB to confirm that the designed FIR filter satisfies the given 
specifications: 

15.11 Using the Kaiser window, design a bandpass FIR filter based on the 
following specifications: 


pass-band edge frequencies = 0.4 jt and 0.6:r; 
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stop-band edge frequencies = 0.27 r and 0.8? r; 
maximum pass-band ripple < 0.02; 
maximum stop-band ripple <0.009. 

UseMATLAB to confirm that the designed bandpass FIR filter satisfies 
the given specifications. 

15.12 Using the Kaiser window, design a bandstop FIR filter based on the 
following specifications: 

stop-band edge frequencies = 0.37T and 0.77r; 
pass-band edge frequencies = 0.4 t r and 0.6? r; 
maximum pass-band ripple <0.05; 
maximum stop-band ripple <0.05. 

UseMATLAB to confirm that the designed bandstop FIR filter satisfies 
the given specifications. 

15.13 Equation (15.44) defines the expression for the normalized weighting 
function used in the design of a lowpass filter using the Parks-McClellan 
algorithm Derive the expressions for the normalized weighting functions 
for highpass, bandpass, and bandstop filters. 

15.14 For a type I FIR filter of length N, show that the degree L of the error 
function e(f2) defined in Eq. (15.42) is given by (N — l)/2. 

15.15 Repeat Problem 15.14 for a type II FIR filter of length N by showing 
that the degree L of the error function e(S 2) = l’(cos(U)) defined in Eq. 
(15.42) is given by (N — 2)/2. 

15.16 Repeat Problem 15.14 for a type III FIR filter of length N by showing 
that the degree L of the error function £(17) defined in Eq. (15.42) is 
given by (N — 3)/2. 

15.17 Repeat Problem 15.14 for a type IV FIR filter of length N by showing 
that the degree L of the error function £(12) defined in Eq. (15.42) is 
given by ( N — 2)/2. 

15.18 Truncate the impulse response of an ideal bandstop FIR filter with edge 
frequencies of 0.2 5 jt and 0.75 t r with a 20-tap rectangular window filter. 
Plot the magnitude response of the resulting FIR filter and compare the 
frequency characteristics with a 40-tap FIR filter. 

15.19 Using Matlab, determine the impulse response of the FIR filters 
designed in Problems 15.4 and 15.5. Sketch the magnitude response and 
ensure that the FIR filters satisfy the given specifications. Comment on 
the complexity and frequency characteristics of the designed filters. 
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15.20 Using Matlab, determine the impulse response of the optimal FIR 
filter for the specifications provided in Problem 15.4. You may use the 
Kaiser window to determine the length of the optimal FIR filter. Sketch 
the magnitude response of the optimal FIR filter and compare its fre- 
quency characteristics with those of the FIR filters plotted in Problem 
15.18. 


15.21 Show that the alternation theorem is satisfied for the magnitude response 
of the optimal FIR filter designed in Problem 15.20. 

15.22 Using the firl function in Matlab, design a 41 -tap lowpass filter 
with a normalized cut-off frequency of fi n = 0.55 using (i) rectangular; 
(ii) Hamming; (iii) Blackman; and (iv) Kaiser (with /3 = 4) windows. 
Plot the amplitude-frequency characteristics for the four filters. For each 
plot, determine (i) the maximum pass-band ripple; (ii) the peak side lobe 
gain; and (iii) the transition bandwidth. Assume that the transition band 
is a band where the filter gain drops from -2 dB to -20 dB. 

15.23 Using the firl function in Matlab, design a 45-tap linear-phase 
bandpass FIR filter with pass-band edge frequencies of 0.457T and 0.657T , 
stop-band edge frequencies of 0.1 5 jt and 0.9 jt, maximum pass-band 
attenuation of 0.1 dB, and minimum stop-band attenuation of 40 dB. 
Use the Kaiser window for your design and sketch the frequency char- 
acteristics of the resulting filter. 


15.24 The fir2 function in Matlab is used to design FIR filters with 
arbitrary frequency characteristics. Using fir2, design a 95-tap FIR 
filter with the following frequency characteristics: 


mm = 


0.85 0 < |J2 n | < 0.15 

0.55 0.20 < |17„| < 0.45 

1 0.55 < |17„| < 0.75 

0.5 0.78 < |J? n | < 1, 


where fi n is the normalized DT frequency. Use Matlab to confirm 
that the designed FIR filter satisfies the given specifications. 


CHAPTER 



HR filter design 


Based on the length of the impulse response h[k]. Chapter 14 classified digital 
(or “discrete-time”) filters into two categories: finite impulse response (FIR) 
filters and infinite impulse response (HR) filters. The design techniques for 
the FIR filter, with an impulse response li[k] of finite length, were covered in 
Chapter 15. In this chapter, we present design methodologies of the HR fil- 
ters. A common technique used to design HR filters is based on mapping the 
DT frequency specifications H(f2) of the HR filters in the f2 domain to the 
CT frequency specifications H(a>) specified in the w domain. Based on the 
transformed specifications, a CT filter is designed, which is then transformed 
back into the original DT frequency fl domain to obtain the transfer func- 
tion of the required HR filter. In this chapter, we present two different DT to 
CT frequency transformations. The first method is referred to as the impulse 
invariance transformation, which provides a linear transformation between the 
DT and CT frequency domains. At times, the impulse invariance transforma- 
tion suffers from aliasing, which may lead to deviations from the original DT 
specifications. An alternative to the impulse invariance transformation is the 
bilinear transformation, which is a non-linear mapping between the CT and DT 
frequency domains. The bilinear transformation eliminates aliasing to a large 
extent. 

A classical problem in the design of digital filters is the selection between 
FIR and IIR filters. While both types of filters can be used to satisfy a given set 
of specifications, the order N of IIR filters is in general much lower than that of 
FIR filters. As a consequence of the lower order N, the IIR filters have reduced 
implementation complexity and less propagation delay when compared with 
FIR filters designed for the same specifications. However, IIR filters are imple- 
mented using feedback loops, resulting in transfer functions with a significant 
number of poles. IIR filters are, therefore, susceptible to instability issues when 
realized on finite-precision DSP boards. In addition, IIR filters have a non-linear 
phase, whereas FIR filters can be designed with a linear phase. An appropriate 
digital filter type is selected based on the requirement of a given application. 
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The organization of this chapter is as follows. HR filter design principles are 
introduced in Section 16.1. Sections 16.2 and 16.3 present design principles 
of lowpass HR filters based on the frequency transformation methods. In Sec- 
tion 16.2, we introduce the impulse invariance transformation, and in Section 
16.3 we present the bilinear transformation. The analytical design procedure is 
illustrated through a series of examples. We also provide the Matlab code, 
which can also be used in the design of HR filters. Section 16.4 covers the design 
techniques for bandpass, bandstop, and highpass filters. Finally, Section 16.5 
compares the frequency characteristics of HR filters with those of FIR filters 
designed for the same specifications. Section 16.6 presents a summary of the 
important concepts covered in the chapter. 


16.1 HR filter design principles 


As specified in Chapter 14, the transfer function of an HR filter is given by 


bo + b\z 1 + ■ • • + bf^i M 
1 + aiz~ l H h a N z~ N 


(16.1) 


where b r , for 0 < r < M, and a r , for 0 < r < N, are known as the filter coeffi- 
cients. In Eq. (16. 1 ), we have also normalized the coefficient ao (corresponding 
to r — 0) in the denominator to unity. Based on Eq. (16.1), the HR filter can 
alternatively be modeled by the following linear, constant-coefficient difference 
equation: 


y[k] + a\y[k - 1] H h a N y[k - N] — b 0 x[k] + bix[k - 1] 


+ • ■ ■ + b^x[k — M\. 


(16.2) 


The objective of the HR filter design is to calculate a set of filter coefficients b r , 
for 0 < r < M, and a r , for 1 < r < /V, such that the frequency characteristics 
of the HR filter match the design specifications. HR filter design can, therefore, 
be viewed as a mathematical optimization problem. 

A popular method used to design an HR filter is based on converting its desired 
frequency specifications //(I?) into the CT frequency domain. Using the CT 
design techniques for the Butterworth, Chebyshev, or elliptic filters covered in 
Chapter 6, the transfer function His) of the analog filter is determined. The z- 
transfer function H(z) of the desired HR filter is then obtained by transforming 
H(s) back into the DT domain. Such transformation approaches yield closed- 
form transfer functions for the HR filters. 

A number of transformations have been proposed to convert the transfer 
function H(s) of the CT (or analog) filter into the z-transfer function // (z.) of 
the HR filter such that the frequency characteristics of the CT filter in the s-plane 
are preserved for the HR filter in the z-plane. These transformations include the 
following methods: 
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(a) finite-difference discretization of differential equations; 

(b) mapping poles and zeros from the s-plane to the z-plane; 

(c) impulse invariance method; 

(d) bilinear transformation. 

The finite-difference discretization of differential equations is a straightforward 
method to derive difference equation representations for digital filters. First, 
the s-transfer functions, obtained by using the CT filter design techniques, are 
used to calculate the input-output relationship of the equivalent CT filter. These 
relationships are generally in the form of linear, constant-coefficient differential 
equations, and are discretized to obtain difference equations that represent the 
input-output relationships of the designed DT filters. 

In the second method, referred to as the matched z-transform technique, the 
s-plane poles and zeros of a designed CT filter are mapped to the z-plane. The 
s-plane poles and zeros are then used to derive the transfer function H(z) of the 
digital HR filter. 

The impulse invariance method samples the impulse response h(t) of an 
LTIC system to derive the impulse response h[k] of the corresponding LTID 
system. Finally, the bilinear transformation provides a one-to-one, non-linear 
mapping from the s-plane to the z-plane. The impulse invariance and bilin- 
ear transformations are the focus of this chapter. In Section 16.2, we cover 
the impulse invariance method followed by the bilinear transformation, in 
Section 16.3. 


16.2 Impulse invariance 


To derive the impulse invariance transformation, we approximate the impulse 
response h(t) of a CT filter with its sampled representation, 

OO OO 

hit) « E hit)8(t - nT) = h(nT)8(t - nT), (16.3) 

n = — oo n=—o o 

obtained by sampling h{t) with an impulse train ^<5(f - nT). Clearly, the 
approximation in Eq. (16.3) improves as the sampling interval T -> 0. The DT 
impulse response h [k] of the equivalent HR filter is obtained from the samples 
h(kT) and is given by 

CO 

h[k] = h(kT) = h(nT)8(k - n). (16.4) 

n = — oo 

Comparing the expressions for the Laplace transform of Eq. (16.3) given by 

CO 

H{s)= h(nT)e~ nTs 

n=—c o 


Laplace transform 


(16.5) 
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Fig. 16.1. Impulse invariance 
transformation from the s-plane 
(a) to the z-plane (b). 



(a) 


Im{z} 



and the z-transform of Eq. (16.4) given by 

OO 

z-transform tl(z) = h(nT)z ~ n , (16.6) 

k=—oo 

we note that the two expressions are equal provided 

Z = e r \ (16.7) 

In terms of real and imaginary components of s = a + j&>, Eq. (16.7) can be 
expressed as follows: 


z = e )<o1 ■ (16.8) 

Equation (16.7) provides a mapping between the DT variable z and the CT 
variable s. The mapping, commonly referred to as the impulse invariance trans- 
formation, is illustrated in Fig. 16.1, where we observe that the s-plane region 

Re{s} = a < 0 and |Im{s}| = \u>\ < Jt/T, 

shown as the shaded region, in Fig. 16.1(a) maps into the interior of the unit 
circle Izl < 1 shown in Fig 16.1(b). Equations (16.7) and (16.8) can also be 
used to derive the following observations. 

Right-half s-plane Re{s} > 0 Taking the absolute value of Eq. (16.8) yields 
|z| = |e" r | ■ |e j “ r | = |e cr7 ’|. (16.9) 

In the right-half s-plane, Re{s} = a > 0, resulting in Izl > 1. Therefore, the 
right-half s-plane is mapped to the exterior of the unit circle. 

Origins = 0 Substituting s = 0 into Eq. (16.7) yields z = 1. The origin s = 0 
in the s-plane is therefore mapped to the coordinate (1, 0) in the z-plane. 


Imaginary axis Re{s} = 0 Taking the absolute value of Eq. (16.8) and substi- 
tuting Re{s} = a — 0 yields |z | = 1. The imaginary axis Re{s} = 0 is therefore 
mapped on to the unit circle |z| = 1. 
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Left-half s-plane Re{s } < 0 Substituting Re{s} = a < 0 in Eq. (16.9) yields 
| z | < 1 ■ Therefore, we observe that the left-half s-plane is mapped to the interior 
of the unit circle. We now show that the mapping z = e sT is not a unique 
one-to-one mapping and that different strips of width 2tt /T are mapped into 
the same region within the unit circle kl < 1- 

Consider the set of points s = gq + )2kn/T , with k = 0, ±1, ±2, . . . , in the 
s-plane. Substituting s = gq +)2kn/T in Eq. (16.7) yields 

z = Q T ^o+}2kn/T) = e a 0 T e i2k7T = _ (16.10) 

In other words, the set of points s = gq + ]2kn/T are all mapped to the same 
point z = exp(a()7'j in the z-plane. Equation (16.8) is, therefore, not a unique, 
one-to-one mapping, and different strips of width 2tt /T in the left-half s-plane 
are mapped to the same region within the interior of the unit circle. 

We now illustrate the procedure used to obtain an equivalent H(z) from an 
impulse response h(t) through Examples 16.1 and 16.2. 


Example 16.1 

Use the impulse invariance method to convert the s-transfer function 


H(s) = 


1 

s + a 


into the z-transfer function of an equivalent LTID system. 


Solution 

Calculating the inverse Laplace transform of H(s) yields 

h(t) — e~ at u(t). 

Using impulse train sampling with a sampling interval of T, the impulse 
response of the LTID system is given by 

h(kT) = 6~ akT u(kT) or h[k] = e~ akT u[k]. 

The z-transfer function of the equivalent LTID system is given by 

H(z) = z{h[k]} = 1 ——, ROC : |z| > e~ aT . 

1 — e~ aJ z~ l 

Figure 16.2 compares the impulse response hit) and transfer function H(s) 
of the LTIC system with the impulse response h[k] and transfer function 
H(z) of the equivalent LTID system obtained using the impulse invariance 
method. A sampling period of T = 0.1 s and a = 0.5 are used. Comparing 
the CT impulse response /r(f), plotted in Fig. 16.2(a), with the DT impulse 
response h[k], plotted in Fig. 16.2(c), we observe that h[k] is a sampled ver- 
sion of h{t), and the shapes of the impulse responses are fairly similar to each 
other. 
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Fig. 16.2. Impulse invariance 
method used for transforming 
analog filters to digital filters in 
Example 16.1. (a) Impulse 
response h(t) and 
(b) magnitude spectrum H(w) of 
the analog filter, (c) Impulse 
response h[k] and 
(d) magnitude spectrum H (1 2 ) 
of the transformed digital filter. 


Comparing the magnitude spectrum \H(oo)\ of the LTIC system with the 
magnitude spectrum \ of theLTID system plotted in Figs. 16.2(b) and (d), 

respectively, we observe two major differences. First, the magnitude spectrum 
\H(f2)\ is periodic with a period of 2tt . Secondly, the magnitude spectrum 
is scaled by a factor of 1 /T in comparison with |//(a>)|. In order to 
obtain a DT filter with a DC amplitude gain of the same value as that of the CT 
filter, we multiply the sampled impulse response h \k ] by a factor of T : 

h[k] = ThikT) = T e~ akT u(k). (16.11) 


Alternatively, the following transform pair can be used for the impulse invari- 
ance transformation: 


1 impulse invariance T 



or 



(16.12) 


Example 16.2 illustrates the application of Eq. (16.12) in transforming a But- 
terworth lowpass filter into a digital lowpass filter. 


Example 16.2 

Consider the following Butterworth filter: 


H(s) = 


81.6475 

s 2 + 12.7786s + 81.6475 ’ 


Use the impulse invariance transformation to derive the transfer function of the 
equivalent digital filter. 
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Solution 

Expressing the transfer function of the CT filter as follows: 


His) = 12.7786- 


6.3894 


(16.13) 


(s + 6.3893) 2 + 6.3894 2 ’ 

and Calculating the inverse Laplace transform, the impulse response of the CT 
filter is given by 


h{t) = 12.7786e” 6 - 3893 ' sin(6.3894t) M (f). (16.14) 

Using Eq. (16.1 1) to derive the impulse response of the DT filter, we obtain 
h[k] = Th(kT) = 12.7786T e” 6 ' 3893 * 7 ' sin(6.3894fc7>(A:r) (16.15) 


or 


h[k] = 12.7786T e -6 - 3893 * 7 sin(6. 3 894A: 7 ^ )m [A r] . (16.16) 


Calculating the z-transform of Eq. (16.16), the transfer function of the DT filter 
is given by (see Problem 16.2) 


H(z) = 


12.7786 T e" 6 - 3893 T sin(6.38947> 
z 2 — 2 z e~ 63&93T cos(6.3894r)z + e _2x6 - 3S93:r 


(16.17) 


Alternative solution Equation (16.17) can also be derived by using the 
impulse invariance transformation specified in Eq. (16.12). Using partial frac- 
tion expansion, H(s) is expressed as follows: 


H(s) = 


12.7786 

2j 


1 

s + 6.3893 — j6.3894 


1 

s + 6.3893 +j6.3894j ’ 

(16.18) 


which is then transformed using Eq. (16.12) in the z-domain: 

zT zT 

, _ g— <6.3893— j6. 3894) 7" , _ e -(6.3893+j6.3894)7’ ' 

It is straightforward to show that the above expression reduces to Eq. (16.17). 


H(z) = 


12.7786 


2j 


Selection of the sampling interval To choose an appropriate sampling interval 
T, we need to analyze the magnitude spectrum of hit). Substituting ,y = joi in 
Eq. (16.13), we obtain 

6.3894 81.6489 

Him) = 12.7786 = , 

(j® + 6.3893) 2 + 6.3894 2 (81.6489 - co 2 ) +jl2.7788« 

(16.19) 


which leads to the following magnitude spectrum: 


|tf(«)l = 


81.6489 

V(8 1.6489 - co 2 ) 2 + 163.2977a> 2 ' 


(16.20) 
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Table 16.1. DT filters obtained in Example 16.2 
for different values of the sampling interval T 
The magnitude spectra of these transfer functions 
are plotted in Figs. 16.3(b)-(e) 


T 

H(z ) 


0.1 

H(z) = 

0.4023z 

z 2 - 0.8475z + 0.2786 

0.0348 

H(z) = 

0.0785z 

z 2 - 1.5619^ + 0.6410 

0.01 

H(z) = 

O.OOllz 

z 2 - 1.8724z + 0.8800 

0.001 

H(z) = 

8.113 x 10^ 5 z 

z 2 - 1.9872z + 0.9873 


The peak value of the magnitude spectrum \H(oS)\ occurs at co = 0. with a 
value |//(0)| = 1. Also, the magnitude spectrum ll((o)\ is a monotonically 
decreasing function with respect to co. Assuming that the maximum frequency 
present in the function h(t) is approximated as &> max such that // (o>)\ < 0.01 
for | cu | > ft> max , it can be shown that w max = 90.4 radians/s. Using the Nyquist 
sampling rate, the sampling interval is therefore given by 


1 

T < 

2 /"max 


2jt 

2ft) max 


0.348 s. 


Table 16.1 compares the transfer function of the transformed DT filters obtained 
by substituting different values of the sampling intervals T into Eq. (16.17). 
The amplitude gain responses of the DT filters for different values of T = 0.1, 
0.0348, 0.01, and 0.001 are given in Table 16.1. A comparison of the magnitude 
spectra of the four transfer functions is illustrated in Fig. 16.3. We make the 
following observations. 


(1) Although the shapes of the magnitude spectra (Figs. 16.3(b)-(d)) of the 
digital filters appear to be different, they are all valid representations of the 
magnitude spectrum of the analog filter (Fig. 16.3(a)). Substituting s = j&> 
and z = into Eq. (16.7) yields 

fl = coT. 


The 3 dB frequency l?o of the digital implementations therefore 
depends upon the sampling interval T. Based on the 3dB frequency 
ft> 0 = 9.03 radians/s, the values of l?o are given by 0.2874 tt radians/s for 
T — 0.1 s, by 0.17T radians/s for T = 0.0348 s, by 0.0287 tt radians/s for 
T — 0.01 s, and by 0.00297T radians/s for T = 0.001 s. 


721 


16 HR filter design 



-60 -40 -20 0 20 40 60 



(c) 


Fig. 16.3. Impulse invariance 
transformation used to derive 
digital representations of the 
analog filter specified in Example 
16.2. Magnitude spectra of 
(a) the analog filter with transfer 
function H(s); (b) the digital 
filter with sampling interval 
T = 0.1 s; (c) the digital filter 
with T = 0.0348 s; (d) the 
digital filter with T = 0.01 s; 

(e) the digital filter with 
T = 0.001 s. 



-7i -0.8k -0.6k -0.4k -0.2k 0 0.2k 0.4;r 0.6k 0.8tt k 


(b) 



(d) 



qI li. 

-k -0.8tt -0.6k -0.4k -0.2k0 0.2 k 0.4jt 0.6rr 0.8;r k 


(e) 


(2) Among the digital implementations, Fig. 16.3(b) results in the highest 
gain (i.e. lowest attenuation) at the stop-band frequency 17 = ±jt radians/s. 
Since the sampling interval ( T =0.1 s) is greater than the Nyquist bound 
(T = 0.0348 s), Fig. 16.3(b) suffers from aliasing, which increases the gain 
within the pass band. In using impulse invariance transformation, it is crit- 
ical that the effects of the aliasing be considered within the stop band. 


16.2.1 Impulse invariance transformation using Matlab 

Matlab provides a library function imp invar to transform CT transfer 
functions into the DT domain using the impulse variance method. We illustrate 
the application of impinvar for Example 16.2 with the sampling interval T 
set to 0.1 s. The Matlab code for the transformation is as follows: 

>> num =[00 81.6475]; % numerator of CT filter 

>> den = [1 12.7786 81.6475]; % denominator of CT filter 
» T = 0.1; 

>> Fs = 1/T; % sampling rate 

>> [numz,denz] = impinvar (num, den, Fs ) ; 

% numerator & denominator 


% of DT filter 
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The above Matlab code results in the following values for the coefficients 
of H(z): 

numz = [0 0.4023 0] and denumz = [1 -0.8475 0.2786], 


which correspond to the following transfer function: 


H(z) = 


0.4023 z 

z 2 — 0.8475z + 0.2786’ 


The above expression is the same as the one obtained analytically, and it is 
included in row 1 of Table 16.1. 


16.2.2 Look-up table 


Examples 16. 1 and 16.2 present direct methods to compute the impulse response 
h [fc], or correspondingly the transfer function H(z), of the DT filter by sampling 
the impulse response h(t) of an analog filter. The process can be simplified 
further in cases where the transfer function H(s) of the analog filter is a rational 
function. In such cases, the transfer function // (,v ) can be expressed in terms of 
partial fractions as follows: 


r=i 


s + a r 


(16.21) 


where k r is the coefficient of the rth partial fraction. Applying the impulse 
invariance transformation, Eq. (16. 12), the transfer function H(z) of the digital 
filter is given by 


^) = E- 


k,z 


-a r T ' 


(16.22) 


Table 16.2 lists a number of commonly occurring s-domain terms and the 
equivalent representation in the z-domain. We now list the steps involved in 
the design of digital HR filters using the impulse invariance transformation. 


16.2.3 HR filter design using impulse invariance transformation 

The steps involved in designing HR filters using the impulse invariance trans- 
formation are as follows. 


Step 1 Using fi = coT, transform the specifications of the digital filter from 
the DT frequency J? domain to the CT frequency co domain. For convenience, 
we choose T = 1. 


Step 2 Using the analog filter techniques (see Chapter 7), design an analog 
filter IKs) based on the transformed specifications obtained in step 1. 


Step 3 Using the impulse invariance transformation specified in Eq. (16.12), 


1 


impulse invariance 
< > 


zT 


1 — e~ 


s + a 


or 
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Table 16.2. Analog to-digital transformation using impulse invariance method 



CT domain 



DT domain 

H(s) 

h(t) 

h[k] 


H(z) 

1 

m 

TS[k] 


T 

1 

s 

u{t) 

Tu[k] 


T Tz 

1 - z~ l z — 1 

1 

s 2 

tu(t) 

kT 2 u[k ] 


T 2 z~ x T 2 z 

(1 - z- 1 ) 2 ~ (z- l) 2 

1 

e~°“u(t) 

T&- akT u[k ] 


T Tz 

J + Q! 


(1 — e - “ r z _1 ) (z — e~“ r ) 

1 

teT a, u(t) 

kT 2 e~ akT u[k] 


T 2 e~ aT z~ 1 T 2 e~ aT z 

(s + a) 2 


(1 — e~ aT z~ 1 ) 2 (z — e~ aT ) 2 

s + a 

e““' cos (Pt)u(t) 

T e~ akT cos(/S kT)u 


Tz[z-e~ aT cos(PT)] 

(s + a) 2 + [I 2 

z 2 — 2e~ aT cos(jST)z + e~ 2aT 

P 

e”“' sin (fit)u(t) 

T e~ akT sin (pkT)u 

w 

T ze~ aT sin (/ST) 

(s + a) 2 + ft 2 

z 2 — 2e~“ r cos(f)T)z + e~ 2aT 


or the look-up table approach, derive the z-transfer function H(z) from the 
s-transfer function I Us). 

Step 4 Confirm that the z-transfer function // (z) obtained in step 3 satisfies the 
design specifications by plotting the magnitude spectrum \H(f2)\. If the design 
specifications are not satisfied, increase the order N of the analog filter designed 
in step 2 and repeat steps 2-4. 

We now illustrate the application of the above algorithm in Example 16.3. 

Example 16.3 

Design a lowpass HR filter with the following specifications: 

pass band (0 < |f2| < 0.257T radians/s) 0.8 < \H(fi)\ < 1; 

stop band (0.75 jt < |17| < it radians/s) \H(f2)\ < 0.20. 


Solution 

Choosing the sampling interval T — 1 , step 1 transforms the given specifications 
of the DT filter into the corresponding specifications for the CT filter: 

0.8 < |//(«)| < 1; 

\H(co)\ < 0.20. 


pass band (0 < |a>| < 0.257 r radians/s) 
stop band (|&>| > 0.757T radians/s) 
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Step 2 designs the analog filter based on the transformed specifications. We use 
the Butterworth filter, whose design procedure is outlined in Section 7.3. 1.1. 


Design of the analog Butterworth filter To determine the order N of the filter, 

we calculate the gain terms: 

1 


and 


Gp_ (l-S P ) 2 


G s = 


(^s ) 2 


- 1 = 0.5625 


1 = 24. 


The order N of the filter is therefore given by 

1 ln(G p /G s ) 1 ln(0. 5 625/24) 

2 ln(u>p/ft) s ) 2 ln(0.257r/0.757r) 

Using Table 7.2, the transfer function for the normalized Butterworth filter of 
order N = 2 is given by 

1 

H(S) = . 

S 2 + 1.4145+ 1 

Equation (7.32) determines the cut-off frequency a> c of the Butterworth filter 
from the stop-band constraint as follows: 
co s Q.15 tc 

= 0.3 3 897T radians/s. 


" (G s )°- 5 /w 24 0 - 25 

The transfer function H(s ) of the required analog lowpass filter is given by 

1 


H(s) = H(S)\ s=s/a>c = 


M 5 2 + 1.4145+1 
1.1332 


S=i/0.3389w 


,v 2 + 1.50553? + 1.1332 


which can be expressed as follows: 
H(s) = 1.5053- 


0.7528 


(s + 0.7528) 2 + 0.7528 2 ' 

Using Table 16.2, step 3 derives the z-transfer function as follows: 

Z e“ 0 - 7528 sin(0.7528) 


H(z) = 1.5053 


Z 2 — 2e -0 - 7528 cos(0.7528)z + e~ 2(0 - 7528) ’ 


which simplifies to 


H(z) = 1.5053 


0.3220z 

z 2 — 0.6875z + 0.2219 


Step 4 computes the magnitude spectrum by substituting z = exp(ji7). The 
resulting plot is shown in Fig. 16.4(a), where we observe that the magnitude 
spectrum satisfies the pass-band requirements, though the dc gain of the filter 
is not equal to unity. The stop band requirement is not satisfied, however, as the 
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Fig. 16.4. Design of the HR filter 
specified in Example 16.3 based 
on the analog Butterworth filter 
of order (a) N = 2; (b) N = 3; 
(c) N = 4. The impulse 
invariance transformation is 
used to convert the Butterworth 
filter to a digital filter. Aliasing 
introduced by the impulse 
invariance transformation results 
in a considerably higher order 
(/V = 4) Butterworth filter to 
meet the design specifications. 



(c) 


gain | H{fi) | of the filter is greater than 0.20 at the stop-band corner frequency of 
0.757 r radians/s. The above procedure is repeated for a Butterworth filter of order 
N = 3. 


Iteration 2 for Butterworth filter of order N — 3 The transfer function for 
the normalized Butterworth filter of order N = 3 is obtained from Table 7.2 as 
follows: 


H(S) = 


1 

(S + l)(S 2 + S+ 1)' 


The cut-off frequency co c of the Butterworth filter is obtained from the stop-band 
constraint: 


co s 

Wc = (G s )°-5/" 


0.75t r 
24 h 6 


= 0.44 16tt radians/s. 


The transfer function H(s) of the required analog lowpass filter is given by 

1 


H(s) = H(S)\ s=s/a>c = 


(S+ 1)(S 2 + S+ 1) 
2.6702 


5 = 5 / 0 . 4416 ^ 


+ 2.7747s 2 + 3.8494s + 2.6702' 


Expanding H(s ) in terms of partial fractions and using Table 16.2, we can derive 
the z-transfer function of the equivalent digital filter as follows: 

0.4695z 2 + 0.19072; 

Z ~ z 3 - 0.6106" 2 + 0.3398z - 0.0624' 

The above derivation is left as an exercise for the reader in Problem 16.3(a). 

Figure 16.4(b) plots the magnitude spectrum \H(D)\ of the third-order biter. 
We observe that the attenuation is increased at the stop-band corner frequency of 
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0.75jt radians/s, but that it is still greater than the specified value. We therefore 
repeat the above procedure for a Butterworth filter of order N — 4. 


Iteration 3 for Butterworth filter of order N — 4 The transfer function for 
the normalized Butterworth filter of order IV = 4 is obtained from Table 7.2 as 
follows: 


H(S) = 


1 

(s 2 + 0.7654s + l)(s 2 + 1. 8478s + 1)' 


The cut-off frequency co c of the Butterworth filter is obtained from the stop-band 
constraint: 


co s U. /5 Jt 

a> = — — = — — = 0.50417T radians/s. 

(Gs) 0 - 5 /^ 24'/s 

The transfer function H{s) of the required analog lowpass filter is given by 


H(s) = H(S) \ s=s/o>c 


1 


(s 2 + 0.7654s + l)(s 2 + 1.8478s + 1) 


S=j/0.5041tt 


which reduces to 


H (s) = 


6.2902 

s 4 + 4.1383s 3 + 8.5630s 2 + 10.3791s + 6.2902' 


Problem 16.3(b) derives the z-transfer function of the equivalent digital filter 
as follows: 


H(z) = 


0.3298 z 3 + 0.4274z 2 + 0.0427z 
z 4 - 0.4978" 3 + 0.3958z 2 - 0. 1 197z + 0.0159 ' 


Figure 16.4(c) plots the magnitude spectrum | H{fi)\ of the fourth-order filter. 
We observe that both pass-band and stop-band requirements are satisfied by the 
Butterworth filter of order N — 4. 


Impulse invariance transformation using Mat lab Starting with the ana- 
log Butterworth filter, the HR filters in Example 16.3 can also be designed 
using the Matlab function impinvar. The syntax to call the function is 
given by 


[numz , denumz ] = impinvar (nums , denums , fs ) 
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where num and denum specify the coefficients of the numerator and denomi- 
nator of the analog filter and f s is the sampling rate in samples/s. For Example 
16.3, the Matlab code is given by 

» fs = 1; % fs = 1/T = 1 

>> nums = [1.1332]; % numerator of CT filter 

>> denums = [1 1.5055 1.1332]; % denominator of CT filter 

>> [numz , denumz ] = impinvar ( nums , denums , f s ) ; 

% coefficients of the DT 
% filter 


which returns the following values: 

numz = 0.4848 and denumz = [1.0000 -0.6876 0.2219], 


The transfer function of the second-order HR filter is given by 


H{z) = 


0.4848c 

z 2 - 0.6875c + 0.2219' 


which yields the same expression as the one derived in Example 16.3. 

For the third-order Butterworth filter, the Matlab code for the impulse 
invariance transformation is given by 


>> 

>> 

» 


» 


f S = 1 ; 

nums = [2.6702]; 
denums = [1 2.7747 


[ numz , denumz ] 


% fs = 1/T = 1 
% numerator of the CT filter 
3.8494 2.6702]; 

% denominator of the CT filter 
impinvar (nums , denums , f s ) ; 

% coeffs of the DT filter 


which returns the following values: 


numz = [0 0.4695 0.1907] and denumz = [1.0000 -0.6106 
0.3398 -0.0624] . 


The transfer function of the third-order HR filter is given by 


H(z) = 


0.4695z 2 + 0.1907c 
c 3 - 0.6106c 2 + 0.3398c - 0.0624' 


728 


Part III Discrete-time signals and systems 


Similarly, the Matlab code for transforming the fourth-order Butterworth 
filter is given by 

>> fs = 1; % fs = 1/T = 1 

>> nums = [6.2902]; % numerator of the CT filter 

» denums = [1 4.1383 8.5603 10.3791 6.2902]; 

% denominator of CT filter 
>> [ numz , denumz ] = impinvar (nums , denums , fs ) ; 

% coefficients of the DT filter 

which returns the following values: 

numz = [0 0.3298 0.4276 0.0428] 

denumz = [1 -0.4977 0.3961 -0.1197 0.0159], 

The transfer function of the fourth-order HR filter is given by 

0.3298 z 3 + 0.4276z 2 + 0.0428;; 

HU ~ z 4 - 0.4977 z 3 + 0.3958z 2 - 0. 1 191 z + 0.0159 ' 

The above expression is similar to the one obtained in Example 16.3 for the 
fourth-order Butterworth filter. 


16.2.4 Limitations of impulse invariance method 

As illustrated in Example 16.3, the impulse invariance method introduces alias- 
ing while transforming an analog filter to a digital filter. Since the analog fil- 
ter is not band-limited, the impulse invariance transformation would always 
introduce aliasing in the digital domain. Therefore, a higher-order DT filter is 
generally required to satisfy the design constraints. Section 16.3 introduces a 
second transformation, known as the bilinear transformation, to eliminate the 
effect of aliasing. 


16.3 Bilinear transformation 


The bilinear transformation provides a one-to-one mapping from the s-plane to 
the z-plane. The mapping equation is given by 

s=k^r7> (16.23) 

z + 1 

where k is the normalization constant given by 2 /T, where T is the sampling 
interval. To derive the frequency characteristics of the bilinear transformation, 
we substitute z = expl ji?) and ,v = ]o> in Eq. (16.23). The resulting expression 
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Fig. 16.5. Bilinear 
transformation between CT 
frequency a> and DT 
frequency fl. 



is given by 


or fl = 2 tan * — , (16.24) 

k 

which is plotted in Fig. 16.5. We observe that the transformation is highly 
non-linear since the positive CT frequencies within the range co = [0, oo] are 
mapped to the DT frequencies fl — [0, tt]. Similarly, the negative CT frequen- 
cies co — [— oo, 0] are mapped to the DT frequencies fl — [— it , 0]. This non- 
linear mapping is known as frequency warping, and is illustrated in Fig. 16.6, 
where an analog lowpass filter is transformed into a digital lowpass filter using 
Eq. (16.24) with k = 1. Since the CT frequency range [— oo, oo] in Fig. 16.5 
is mapped on to the DT frequency range [— jr, 7r], there is no overlap between 
adjacent replicas constituting the magnitude response of the digital filter. Fre- 
quency warping, therefore, eliminates the undesirable effects of aliasing from 
the transformed digital filter. We now show how different regions of the s-plane 
are mapped onto the z-plane. 


fl 

co = k tan— 
2 


Fig. 16.6. Transformation 
between a CT filter H(co) and a 
DT filter H(f2) using the bilinear 
transformation. 


n 
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16.3.1 Mapping between the s-plane and the z-plane 


For k = 1, Eq. (16.23) can be represented in the following form: 

1 + 5 


Substituting s = a + jo> into Eq. (16.25), we obtain 

1 + er + j co 

z = - — , 

1 - er - JO) 

with an absolute value given by 


Izl 


(1 + a) 2 + co 2 
(1 — a) 2 + co 2 


(16.25) 


(16.26) 


(16.27) 


By substituting different values of s = a + jco corresponding to the right-half, 
left-half, and imaginary axes of the s-plane in Eq. (16.27), we derive the fol- 
lowing observations. 


Left-half s-plane (er < 0) For a < 0, we observe that the value of the 
denominator (1 — a) 2 + co 2 in Eq. (16.27) exceeds the value of the numerator 
(1 + a) 2 + co 2 , resulting in |z| < 1. In other words, the bilinear transformation 
maps the left-half of the s-plane to the interior of the unit circle within the 
z-plane. 

Right-half s-plane (17 < 0) For er > 0, the value of the numerator (1 + a) 2 + 
or in Eq. (16.27) exceeds the value of the denominator (1 — er ) 2 + co 2 , resulting 
in |z| > 1. Consequently, the bilinear transformation maps the right-half of the 
s-plane to the exterior of the unit circle within the z-plane. 


Imaginary axis (er = 0) For a = 0, the denominator and numerator in Eq. 
(16.27) are equal, resulting in |z| = 1. The bilinear transformation maps the 
imaginary axis of the s-plane onto the unit circle within the z-plane. 

Note that the mapping in Eq. (16.25) is a one-to-one mapping, which means 
that no two points in the s-plane will map to the same point in the z-plane, and 
vice versa. 


16.3.2 HR filter design using bilinear transformation 

The steps involved in designing IIR filters using the bilinear transformation are 
as follows. 

Step 1 Using Eq. (16.24), co = k tan(l7/2), transform the specifications of the 
digital filter from the DT frequency (17) domain to the CT frequency (co) domain. 
For convenience, we choose k = 1 . 
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Step 2 Using the analog filter design techniques, design an analog filter H(s ) 
based on the transformed specifications obtained in step 1 . 

Step3 Using the bilinear transformation s = (z — I )/(z + 1) (obtained by rear- 
ranging Eq. (16.25) to express z in terms of ,sj, derive the z-transfer function 
H(z) from the s-transfer function H(s). 


Step 4 Confirm that the z-transfer function H (z.) obtained in step 3 satisfies the 
design specifications by plotting the magnitude spectrum \H(f2)\. If the design 
specifications are not satisfied, increase the order N of the analog filter designed 
in step 2 and repeat from step 2. 

We now illustrate the application of the above algorithm in Example 16.4. 

Example 16.4 

Repeat Example 16.3 using the bilinear transformation. 


Solution 

Choosing k = 1 (sampling interval T — 2), step 1 transforms the pass-band and 
stop-band corner frequencies into the CT frequency domain: 

pass-band corner frequency o>„ — tan(0.51? p ) = tan(0.5 x 0.2571) 

= 0.4142 radians/s; 

stop-band corner frequency co s = tan(0.5J? s ) = tan(0.5 x 0.75 tt) 

= 2.4142 radians/s. 

The transformed specifications of the CT filter are given by 

pass-band (0 < \co\ < 0.4142 radians/s) 0.8 < \H(a>)\ < 1; 
stop-band (I® | > 2.4142 radians/s) \H(a>)\ < 0.20. 


Step 2 designs the analog filter based on the transformed specifications. As in 
Example 16.3, we use the Butterworth filter. The gain terms for the filter stay 
the same as in Example 16.3: 


and 


G P 


1 

(1 - <5 P ) 2 


- 1 = 0.5625 



= 24 


The order N of the filter is given by 


1 ln(G p /G s ) 1 ln(0. 5625/24) 

2 X ln(® p /® s ) _ 2 X ln(0.4142/2.4142) 


1.0646, 
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Fig. 16.7. Magnitude response 
\H(fl)\ of the lowpass filter 
designed in Example 16.4 using 
the bilinear transformation. 



which is rounded up to N = 2. Using Table 7.2, the transfer function for the 
normalized Butterworth filter of order N — 2 is given by 

1 

7/(5) = . 

5 2 + 1.4145 + 1 


Using Eq. (7.3 1 ) to determine the cut-off frequency co c of the Butterworth filter, 
we obtain 


co s 

" c = (G s )°- 5/N 


2.4142 

— K - r = 1 .0907 radians/s. 

24°.25 


The transfer function H(s) of the required analog lowpass filter is given by 


1 


H(S) = H(S)\s-s/a> = 

S “ sM 5 2 + 1.4145+1 

1.1897 

~ s 2 + 1.5421s + 1.1897' 


S=s/ 1.0907 


Step 3 derives the z-transfer function of the digital filter using the bilinear 
transformation: 


H(z) — H(s)\ s=(z _ mz+l) 

1 . 1 897(z + l) 2 

_ (z- 1) 2 + 1.5421(z- l)(z+ 1)+ 1.1897(z+ l) 2 ’ 
which simplifies to 

0.3188z 2 + 0.6375z + 0.3188 
Z _ z 2 + 0.1017z + 0.1734 

Step 4 computes the magnitude spectrum by substituting z = exp(jf2). The 
resulting plot is shown in Fig. 16.7, where we observe that the magnitude 
spectrum satisfies the specified pass-band and stop-band requirements. 


Bilinear transformation using Matlab The bilinear function is pro- 
vided in Matlab to transform a CT filter to a DT filter using the bilinear 
transformation. The syntax for calling the bilinear function is similar to 
that of the impinvar function and is given by 


[numz , denumz ] = bilinear (nums , denums , fs ) 
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where nums and denums specify the coefficients of the numerator and denom- 
inator of the analog filter and fs is the sampling rate in samples/s. For 
Example 16.4, the Matlab code is given by 

» fs = 0.5; % fs = 1/T = k/2 =0.5 

>> nums = [1.1897]; % numerator of the CT filter 

>> denums = [1 1.5421 1.1897]; % denominator of CT filter 
>> [numz , denumz ] = bilinear ( nums , denums , f s ) ; 

% coefficients of DT filter 


which returns the values 

numz = [0.3188 0.6376 0.3188]; 

denumz = [1.0000 0.1017 0.1735], 

which are the same as the coefficients obtained in Example 16.4. 

Filter design using Matlab Several additional functions are provided in 
Matlab for directly determining the transfer function of the digital filters . The 
buttord and butter functions, introduced in Chapter 7, can also be used to 
compute HR filters in the digital domain. The buttord function computes the 
order N and cut-off frequency wn of the Butterworth filter, and the butter 
function computes the coefficients of the numerator and denominator of the 
z-transfer function of the Butterworth filter. For lowpass filters, the calling 
syntaxes for the buttord and butter functions are given by 

buttord function: [N, wn] = buttord(wp, ws, rp, rs); 

butter function: [numz, denumz] = butter (N, wn) , 

where N is the order of the lowest-order digital Butterworth filter that loses no 
more than rp dB in the pass band and has at least rs dB of attenuation in the 
stop band. The frequencies wp and ws are the pass-band and stop-band edge 
frequencies, normalized between zero and unity, where unity corresponds to 
7t radians/s. Similarly, wn is the normalized cut-off frequency for the Butter- 
worth filter. The matrix numz contains the coefficients of the numerator, while 
matrix denumz contains the coefficients of the denominator of the transfer 
function of the Butterworth filter. 

For Example 16.4, the Matlab code is given by 

» [N, wn] = buttord(0.25,0.75,20*logl0(0.8) ,20*logl0 
( 0 . 20 ) ) ; 

» [numz , denumz ] = butter (N, wn) ; 
which results in the following coefficients: 

numz = [0.3188 0.6376 0.3188]; 

denumz = [1.0000 0.1017 0.1735], 

which are identical to those obtained analytically in Example 16.4. 
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16.4 Designing highpass, bandpass, and bandstop MR filters 


In the following examples, we design the highpass, bandpass, and bandstop HR 
filters. 

Example 16.5 

Example 15.5 designed a highpass FIR filter for the following specifications: 

(i) pass-band edge frequency f? p = 0.5 tt radians/s; 

(ii) stop-band edge frequency l? s = 0.125^ radians/s; 

(iii) pass-band ripple < 0.01 dB; 

(iv) stop-band attenuation > 60 dB . 

Design an HR filter with the same specifications. 

Solution 

Choosing k = 1 (sampling interval T — 2), step 1 transforms the pass-band and 
stop-band corner frequencies into the CT frequency domain: 

pass-band comer frequency <y p = tan(0.5!7 p ) = tan(0.257r) = 1 radian/s; 
stop-band comer frequency w s = tan(0.5!? s ) = tan(0.0625ir) = 0.1989 radians/s. 

Step 2 designs the analog filter based on the transformed specifications. In 
Chapter 7, we presented the design methodology for deriving the transfer 
function of the analog highpass filter analytically. Here, we use Matlab 
to calculate the analog elliptic filter based on the above specifications: 

>> wp = 1; ws = 0.1989; Rp = 0.01; Rs = 60 ; 

>> [N,wn] = ellipord (wp , ws , Rp, Rs , 's'); 

% Order and cut off frequency 
% of the analog elliptic filter 
>> [nums , denums] =ellip (N, Rp, Rs , wn, 'high' , 's ' ) ; 

% Tx function of the analog 
% elliptic filter 

which yields the following transfer function for the analog filter: 

0.9988s 4 + 0.0542s 2 + 0.000373 
U) ~~ s 4 + 1.872s 3 + 1.824s 2 + 1.04s + 0.3732' 

Step 3 derives the z-transfer function of the digital filter using the bilinear trans- 
formation. This is achieved by using the bilinear function in Matlab. 

>> [numz , denumz ] = bilinear (nums , denums , 0 . 5 ) % DT Filter 

The resulting filter is given by 

0.1725z 4 - 0.6539z 3 + 0.9638z 2 - 0.6539z + 0.1725 
HL) ~ z 4 - 0.6829 z 3 + 0.7518z 2 - 0.138z + 0.0468 
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Fig. 16.8. Magnitude response 
of the DT highpass filter 
designed in Example 16.5. 
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Figure 16.8 shows the amplitude gain response of the designed filter. We observe 
that the pass-band and stop-band specifications are both satisfied. 

Example 16.6 

Example 15.6 designed a bandpass FIR filter with the following specifications: 

(i) pass-band edge frequencies, i? p i = 0.375 tt and l ? p 2 = 0.57T radians/s; 

(ii) stop-band edge frequencies, l? s i = 0.257T and T ? s 2 = 0.6257T radians/s; 

(iii) stop-band attenuations, <5 s i > 50 dB and <5 S 2 > 50 dB. 

Design an HR filter with the same specifications. 

Solution 

Choosing k — 1 (sampling interval T — 2), step 1 transforms the pass-band and 
stop-band corner frequencies into the CT frequency domain: 

pass-band comer frequency 1 a> p i = tan(0.5f? p i) = tan(0.1875;r) = 0.6682 radians/s; 
pass-band comer frequency II w p 2 = tan(0.5f? P 2) = tan(0.25jr) = 1 radian/s; 
stop-band comer frequency 1 ru s i = tan(0.5i2 s i) = tan(0. 1 25n ) = 0.4142 radians/s; 
stop-band comer frequency II co s 2 = tan(0.5f2 S 2) = tan(0.31257r) = 1.4966 radians/s. 

Step 2 designs an analog filter for the aforementioned specifications. We can 
either use the analytical techniques developed in Chapter 7 or use the Matlab 
program. In the following, we calculate the analog elliptic filter for the given 
specifications using Matlab . Since the pass-band ripple is not specified, we 
assume that it is given by 0.03 dB. The Matlab code is given by 

» wp = [0.6682 1]; ws = [0.4142 1.4966]; 

» Rp = 0.03; Rs = 50; 

» [N, wn] = ellipord(wp,ws,Rp,Rs, 's' ) ; 

» [ nums , denums ] = ellip (N, Rp, Rs , wn, 's ' ) ; 

which results in an eighth-order elliptic filter with the following transfer 
function: 

0.001(3. 164i 8 + 30.27j 6 + 57.02s 4 + 13.51j 2 + 0.6308) 

H(S) _ s 8 + 0.7555.C + 3.07s 6 + 1.634 j 5 + 3.229.V 4 + 1.092s 3 + 1 ,371i 2 + 0.2254.V + 0.1994 ' 

Step 3 derives the z-transfer function of the digital filter using the bilinear trans- 
formation. This is achieved by using the bi 1 inear function in Matlab . 
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Fig. 16.9. Amplitude gain 
response of the DT bandpass 
filter designed in Example 16.6. 



>> [numz , denumz ] =bi linear (nums , denums , 0 . 5 ) % DT Filter 
The resulting filter is given by 

0.001 (8.317z 8 - 6.94F + 4.236z 6 - 5.952z 5 + 13.52z 4 - 5.952z 3 + 4.236z 2 - 6.94z + 8.317) 
HL ) - j 8 - 1.389s 7 + 3.714c 6 - 3356z 5 + 4.685c 4 - 2.693.- 3 + 2.397z 2 - 0.7107; + 0.4106 ' 

Figure 16.9 shows the amplitude gain response of the designed filter, which 
illustrates that the pass-band and stop-band specifications are both satisfied. 

Example 16.7 

Example 15.7 designed a bandstop FIR filter with the following specifications: 

(i) pass-band edge frequencies, T? p i = 0.257T and T ? p 2 = 0.625tt radians/s; 

(ii) stop-band edge frequencies, 12 s 1 = 0.3757T and l ? s 2 = 0.57T radians/s; 

(iii) stop-band attenuations, <5 s i > 50 db and b s2 > 50 dB. 

Design an HR filter with the same specifications. 

Solution 

Choosing k = 1 (sampling interval T — 2), step 1 transforms the pass-band and 
stop-band corner frequencies into the CT frequency domain: 

pass-band comer frequency I &> pl = tan(0.5f2 p i) = tan(0.125jr) = 0.4142 radians/s; 
pass-band comer frequency II a) p2 = tan(0.5l7 p2 ) = tan(0.31257r) = 1.4966 radians/s; 
stop-band comer frequency I &> s i = tan(0.3751? s i) = tan(0.1875w) = 0.6682 radians/s; 
stop-band comer frequency cu s2 = tan(0.5f? S 2) = tan(0.257r) = 1 radian/s. 

Step 2 designs an analog filter for the aforementioned specifications. In the fol- 
lowing, we use M ATLAB to derive the analog elliptic filter for the transformed 
specifications and an assumed pass-band ripple of 0.03 dB: 

» wp = [0.4142 1.4966]; ws = [0.6682 1]; 

>> Rp = 0.03; Rs = 50; 

>> [N,wn] = ellipord(wp,ws,Rp,Rs, 's' ) ; 

>> [nums, denums] = ellip (N, Rp , Rs , wn, ' stop ' , ' s ' ) ; 

The resulting elliptic filter is of the eighth order and has the following transfer 
function: 

0.9966.? 8 + 2.8s 6 + 2.854s 4 + 1.25s 2 + 0.1987 
H(S) ~ s 8 + 2.137s 7 + 5.15s 6 + 5.926s 5 + 6.747s 4 + 3.96s 3 + 2.3s 2 + 0.6377s + 0.1994' 

Step 3 derives the z-transfer function of the digital filter using the bilinear 
function. 
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Fig. 16.10. Magnitude response fj 
of the DT bandstop filter 

— 

designed in Example 16.7. 

-40 
-60 

-K -0.157c-0.5n -0.257c 0 0.25 n 0.57c 0.75 n tc 



» [numz , denumz ] =bi linear (nums , denums , 0 . 5 ) ; % DT Filter 
The resulting DT filter is given by 

0.2887c 8 - 0.4484c 7 + 1.363c 6 - 1.372c 5 + 2.149c 4 - 1.372c 3 + 1.363c 2 - 0.4484- + 0.2887 
H, - > ~ z s _ 1 ,096c 7 + 1.977c 6 - 1.519c 5 + 1.78c 4 - 0.8638c 3 + 0.6172c 2 - 0.1739c + 0.09751 

Figure 16.10 shows the magnitude response of the designed bandstop filter. We 
observe that both the pass-band and stop-band specifications are satisfied by 
the bandstop filter. 


16.5 HR and FIR filters 


A classical problem in the design of digital filters is the selection between FIR 
and HR filters since both types of filters can be used to satisfy a given set of 
specifications. In this section, we compare HR and FIR filters with respect to 
three criteria: stability, implementation complexity, and delay. 


16.5.1 Stability 

Stability is a major concern in the design of filters. When designing digital 
filters, care must be taken to ensure that the designed filters are absolutely 
BIBO stable to prevent infinite outputs. Recall that an LTID system is stable if 
its poles lie inside the unit circle in the z-plane. Since the only poles in FIR filters 
lie at the origin (z — 0), FIR filters are always BIBO stable. On the other hand, 
HR filters have non-trivial poles because of the feedback loops and therefore 
may run into stability issues. 

Use of finite-precision DSP boards places a severe limitation on the type of 
HR filters that can be used. Even if the designed HR filter is stable, quantization 
of the filter coefficients can adversely affect its stability. To illustrate the effect 
of quantization on the stability of the filter, consider the following four filters. 

(1) Lowpass filter (arbitrary): 

0.001(3.5747p - 13.649c 6 + 20.9446z 5 - 10.7188c 4 - 10.7188z 3 + 20.9446c 2 - 13.649c + 3.5747) 
HL ) ~ z 7 - 5. 9664c 6 + 15. 5383c 5 - 22. 8594c 4 + 20.49z 3 - 11.1881c 2 + 3.4416c - 0.46 ' 

(2) Highpass filter (Example 16.5): 

0.1725z 4 - 0.6539t: 3 + 0.9638z 2 - 0.6539z + 0.1725 
U ~ z 4 - 0.6829s 3 + 0.75 18z 2 - 0.138z + 0.0468 
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Table 16.3. Pole locations for lowpass MR filter specified as item 
(1) in the list of filters in Section 16.5.1 before and after coefficient 
quantization 

Before quantization 

After aquantization 

0.906248860 + j0.374726030 
0.906248860 - j0.374726030 
0.868476456 +j0.325406471 
0.868476456 - j0.325406471 
0.816276165 + j0.206545545 
0.816276165 - j0.206545545 
0.784371333 

1.052267965 + j0.282343949 
1.052267965 - j0.282343949 
0.884886889 + j0.435649276 
0.884886889 - j0.435649276 
0.720252455 + j0.304944386 
0.720252455 - j0.304944386 
0.651185382 


(3) Bandpass filter (Example 16.6): 

0. 001(8. 317z 8 - 6.94; 7 + 4.236z 6 - 5.952z 5 + 13.52z 4 - 5.952z 3 + 4.236z 2 - 6.94; + 8.317) 
HL ) ~ ; 8 - 1.389z 7 + 3.714c 6 - 3.356; 5 + 4.685; 4 - 2.693; 3 + 2.397; 2 - 0.7107; + 0.4106 

(4) Bandstop filter (Example 16.7): 

0.2887z* - 0.4484; 7 + 1.363z 6 - 1.372; 5 + 2.149z 4 - 1.372; 3 + 1.363z 2 - 0.4484; + 0.2887 
HL '~ z 8 - 1.096; 7 + 1.977; 6 - 1.519; 5 + 1.78z 4 - 0.8638; 3 + 0.6172; 2 - 0.1739z + 0.09751 

The poles and zeros of the four filters are plotted separately in Figs. 16.1 1(a)— 
(d). Since in all cases the poles lie within the unit circle, the four filters are 
absolutely BIBO stable when they are implemented with full precision. 

Now, let us consider the effect of quantization on the stability of the lowpass 
filter. Although most digital systems use binary arithmetic, we will use decimal 
arithmetic for simplicity and assume that the coefficients of the lowpass filter 
(item (1) above) are implemented up to an accuracy of three decimal places 
leading to the following approximated transfer function: 

- _ 0.00 l(4z 7 - 14z 6 + 21z 5 - 1 lz 4 - 1 lz 3 + 21z 2 - 14z + 4) 

Z “ z 7 - 5.966z 6 + 1 5 ,538z 5 - 22.859z 4 + 20.494z 3 - 11.188z 2 + 3.442z - 0.46' 

Although the filters H(z) and // (z) look similar, they are not identical. The 
location of poles can be found by calculating the roots of the characteristic 
equations of H(z) and II (z), and these are listed in Table 16.3. The pole-zero 
locations are shown in Fig. 16.12. It is observed that the two poles in H{z), 
which lie close to (but inside) the unit circle, moved outside the unit circle after 
coefficient quantization. Therefore, although H(z) behaves as a lowpass filter 
after quantization, the filter is no longer absolutely BIBO stable. 

Different implementations of HR filters can be compared to determine relative 
stability by observing how close the poles lie to the unit circle. The highpass 
filter, the with pole-zero plot shown in Fig. 1 6. 1 1 (b), has four poles, which are 
well inside the unit circle. The pole-zero plot of the bandpass filter is shown 
in Fig. 16.11(c). Four of the eight poles in the bandpass filter are close to the 
unit circle, which reduces its relative stability. The bandstop filter has eight 
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(c) 


(d) 


Fig. 16.11. Locations of the 
poles and zeros for HR filters. 

(a) Lowpass (specified as item 1 
in Section 16.5.1); (b) highpass 
(Example 16.5); (c) bandpass 
(Example 16.6); (d) bandstop 
(Example 16.7). 


poles, which are plotted in Fig. 16.1 1(d)). Four of its poles are well inside the 
unit circle, while the remaining four are somewhat close to the unit circle. On a 
relative scale, the highpass filter provides a better resilience against quantization 
among the latter three filters. The bandpass and bandstop filters are sensitive to 
stability issues after quantization. 


16.5.2 Implementation complexity 

In this section, we compare the implementation complexity of the FIR fil- 
ters designed in Examples 15.5-15.7 with that of the HR filters designed in 
Examples 16.5-16.7. Table 16.4 provides a list of the number of adders, mul- 
tipliers, and unit delay elements required in each case. For HR filters, we use 
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Table 16.4. Implementation complexity of FIR and HR filters 
Note that N corresponds to the order of a DT filter 




Number of two-input 
adders 

Number of scalar 
multipliers 

Unit delay elements 

Highpass filter 

FIR (N = 20) 

21 

10 

20 

(Examples 15.5/16.5) 

HR (N = 4) 

8 

9 

4 

Bandpass filter 

FIR (N = 46) 

47 

24 

46 

(Examples 15.6/16.6) 

HR (N = 8) 

16 

17 

8 

Bandstop filter 

FIR (N = 46) 

47 

24 

46 

(Examples 15.7/16.7) 

HR (N = 8) 

16 

17 

8 




(b) 


Fig. 16.12. Locations of the 
poles and zeros of the lowpass 
filter specified as item 1 in 
section 16.5.1 (a) Before 
quantization; (b) after 
quantization of coefficients. 


the direct form II realizations, while the HR filters are implemented using the 
linear implementation (see Section 14.6.3). 

It is observed in Table 16.4 that the complexity of HR filters is significantly 
lower than that for the corresponding FIR filters. For example, the highpass FIR 
filter requires 21 additions, 10 scalar multiplications, and 20 unit delays. On the 
other hand, the highpass HR filter requires only 8 additions, 9 multiplications, 
and 7 unit delays. The difference is more conspicuous for the bandpass and 
bandstop filters, where the orders of the FIR filters are much larger than the 
corresponding orders of the HR filters. 

In summary, for applications such as image and video processing, where 
a smaller-order FIR filter can satisfy the design specifications, FIR filters are 
generally chosen. In other applications, such as acoustics, a filter with a long 
impulse response in the range of 2000 samples is required. In such cases, the 
FIR filter provides a large implementation complexity compared with that for 
an HR filter designed with the same specifications. Between these two extremes, 
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there are a large number of applications where an appropriate filter (FIR or HR) 
is chosen based on implementation cost and robustness. 


16.5.3 Delay 

The propagation delay between the time an input signal is applied and the time 
when the output appears is another important factor in filter selection. Because 
of the larger number of implementation elements, the FIR filters generally have 
a larger delay than the HR filters. 


16.6 Summary 


This chapter presented transformation techniques, namely the impulse invari- 
ance and bilinear transformations, used to design HR filters. These transforma- 
tion techniques are based on converting the frequency specifications //(17) of 
HR filters from the DT frequency 17 domain into the CT frequency specifica- 
tions H(co). Based on the CT frequency specifications, a CT filter with transfer 
function H(s) is designed, which is then transformed back into the original DT 
frequency 17 domain to obtain the transfer function II (z) of the required HR 
filter. Section 16.2 introduced the impulse invariance transformation used to 
design lowpass filters. The impulse invariance method uses a linear expression, 

17 = coT, 

where T is the sampling interval, to convert DT specifications to the CT domain. 
Because of the sampling process, the impulse invariance method suffers from 
aliasing when transforming the analog filter H(s) to the digital filter // (z). A 
consequence of aliasing is that the order N of the designed filter H(z) is much 
higher than the optimal design. To prevent aliasing. Section 16.3 presented 
the bilinear transformation, which transforms the DT specifications to the CT 
frequency domain using the following expression: 

co = k tan(!7/2) or 17 = 2tan -1 (&>/k). 

The transfer function H(s) of the CT filter is then transformed into the z-domain 
using the following transformation: 

1 z- 1 

s = , 

k z + 1 

in which k is generally set to unity. Section 16.4 extended the design techniques 
to highpass, bandpass, and bandstop filters. 

A comparison of HR and FIR filters was presented in Section 16.5. We 
demonstrated that the order of the FIR filter is generally higher than that for HR 
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filters for the same design specifications. Therefore, the implementation cost of 
HR filters is generally lower than for FIR filters. In addition, HR filters generally 
have a lower delay. However, a major limitation in the use of HR filters is the 
stability. Because HR filters are implemented using feedback loops, they have 
non-zero poles. Care should be taken in designing HR filters by ensuring that 
the poles are well inside the unit circle; this achieves good relative stability. FIR 
filters have trivial poles (at z — 0) and are always stable. 

Another approach taken to design HR filters is referred to as the direct design 
method, which derives the filter recursively using a least-squares method. Unlike 
the analog prototyping method, the direct design method is not constrained to 
the standard lowpass, highpass, bandpass or bandstop configurations. Filters 
with an arbitrary, perhaps multiband, frequency response are also possible. In 
Matlab the yulewalk function designs HR digital filters by performing a 
least-squares fit in the time domain. For more details on FIR filter design using 
direct design method, refer to refs. [1] and [2]J 


Problems 


16.1 Using the impulse invariance transformation and a sampling interval of 
T = 0. 1 s, convert the following analog transfer functions to their equiv- 
alent digital transfer functions: 

5+2 

(a) H(s) = 


(b) H(s) = 

(c) H(s) = 


(5 + 4)(5 2 +45 + 3)’ 

5 2 + 9.? + 20 

(5 + 2)(5 2 +45 + 3)’ 

5 3 + 5 2 + 65 + 14 


(5 2 + 5 + 1)(5 2 + 25 + 5) 

16.2 Derive the following z-transform pair used in Example 16.2: 

12.7786T e -6 - 3893,;:r sin(6.3894fc7>[jt] 

z 12.7786T e~ 6 - 3893 T sin(6.38947’)z 

z 1 — 2 ze~ 63&9iT cos(6.3894T)z + e~ 2x6 - 3893 r 


16.3 (a) Use the impulse invariance method to show that the analog transfer 
function given by 

2.6702 

H(s) = 


( 3 + 2.7747s 2 + 3.8494s + 2.6702 


t [1] B. Friedlander and B. Porat, the modified Yule-Walker method of ARMA spectral 
estimation, IEEE Transactions on Aerospace Electronic Systems (1984), AES-20(2), 158-173. 
[2] L. B. Jackson, Digital Filters and Signal Processing , 3rd edn. Kluwer Academic Publishers 
(1996), Chap. 10, pp. 345-355. 
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results in the following z-transfer function: 


H{z) = 


0.4695z 2 + 0.1907z 
z 3 - 0.6106z 2 + 0.3398z - 0.0624 


as stated in Example 16.3 for the third-order Butterworth filter. 

(b) Use the impulse invariance method to show that the analog transfer 
function given by 


H(s) = 


6.2902 

i 4 + 4.1383s 3 + 8.5630s 2 + 10.3791s + 6.2902 


results in the following z-transfer function: 

0.3298 z 3 + 0.4274z 2 + 0.0427z 
2 _ z 4 - 0.4978z 3 + 0.3958z 2 - 0.1 197z + 0.0159 
as stated in Example 16.3 for the fourth-order Butterworth filter. 


16.4 Using the impulse invariance transformation, design a lowpass HR But- 
terworth filter based on the following specifications: 


pass-band edge frequency = 0.64 jt; 
width of transition band = 0.3 tt; 
maximum pass-band ripple <0.002; 
maximum stop-band ripple < 0.005. 

16.5 Repeat Problem 16.4 for a highpass HR Butterworth filter. 

16.6 Figure 9. 1 shows a schematic for processing CT signals using DT sys- 
tems. The overall system should have the CT frequency characteristics as 
follows: 


overall CT system is a lowpass filter; 
pass-band edge frequency = 3 jt kradians/s; 
width of the transition band = 47r kradians/s; 
minimum stop-band attenuation > 50 dB 
maximum pass-band attenuation < 0.03 dB 
sampling rate = 8 ksamples/s, 

Design a digital HR filter that will provide the above characteristics using 

the following steps. 

(a) Derive the DT specifications from the CT specifications using the 
impulse invariance transformation with T = 1/8 x 10~ 3 s. 

(b) Design the digital HR filter using a CT elliptic filter and the bilinear 
transformation. 


16.7 Repeat Problem 16.1 for the bilinear transformation. 

16.8 Design a lowpass HR Butterworth filter specified in Problem 16.4 using 
the bilinear transformation. 
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16.9 Design a highpass HR Butterworth filter specified in Problem 16.5 using 
the bilinear transformation. 

16.10 Using the bilinear transformation, design a highpass HR filter based on 
the following specifications: 

pass-band edge frequency = 0.647r; 
width of transition band = 0.37T; 
maximum pass-band ripple < 0.002; 
maximum stop-band ripple <0.005. 

16.11 Using the bilinear transformation, design a bandpass HR filter based on 
the following specifications. 

pass-band edge frequencies = 0.4 jt and 0.67r; 
stop-band edge frequencies = 0.2 7r and 0.87T; 
maximum pass-band ripple < 0.02; 
maximum stop-band ripple < 0.009. 

16.12 Using the bilinear transformation, design a bandstop HR filter based on 
the following specifications: 

pass-band edge frequencies = 0.37T and 0.7:r; 
stop-band edge frequencies = 0.4 tt and 0.67T; 
maximum pass-band ripple < 0.05; 
maximum stop-band ripple <0.05. 

16.13 Consider the lowpass filter design, using the bilinear transformation and 
analog Butterworth filter in Example 16.4. Repeat the HR filter design 
using (i) Chebyshev Type 1 and (ii) Chebyshev Type 2 CT filters. Plot 
the frequency characteristics of the designed DT filter. 

16.14 Consider the highpass filter design using the bilinear transformation 
and analog elliptical filter in Example 16.5. Repeat the HR filter design 
using (i) Chebyshev Type 1 and (ii) Chebyshev Type 2 CT filters. Plot 
the frequency characteristics of the designed DT filter. 

16.15 Consider the bandpass filter design using the bilinear transformation 
and analog elliptical filter in Example 16.6. Repeat the HR filter design 
using (i) Chebyshev Type 1 and (ii) Chebyshev Type 2 CT filters. Plot 
the frequency characteristics of the designed DT filter. 

16.16 Consider the bandstop filter design using the bilinear transformation and 
analog elliptical filter in Example 16.7. Repeat the HR filter design using 
(i) Butterworth and (ii) Chebyshev Type 2 CT filters. Plot the frequency 
characteristics of the designed DT filter. 

16.17 Quantize the coefficients of the bandpass filters obtained in Problem 
16.15 with a resolution of three decimal points. Are the filters with 
quantized coefficients stable? 
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16.18 Quantize the coefficients of the bandstop filters obtained in Problem 
16. 16 with a resolution of three decimal points. Are the filter with quan- 
tized coefficients stable? 

16.19 Repeat Problem 16.18 with a resolution of one decimal point. 

16.20 By plotting the poles of the highpass filter obtained in Problem 16.10, 
determine if the filter is absolutely stable. Quantize the coefficients of 
the filter with a resolution of three decimal points. Are the filter with 
quantized coefficients stable? 

16.21 By plotting the poles of the bandpass filter obtained in Problem 16.11, 
determine if the filter is absolutely stable. Quantize the coefficients of 
the filter with three decimal points accuracy. Is the filter with quantized 
coefficients stable? 

16.22 By plotting the poles of the bandstop filter obtained in Problem 16.12, 
determine if the filter is absolutely stable. Quantize the coefficients of 
the filter with three decimal points accuracy. Is the filter with quantized 
coefficients stable? 

16.23 Compare the implementation complexity of the highpass FIR filter 
designed in Example 15.5 and the HR filters designed in Problem 16.14. 

16.24 Compare the implementation complexity of the bandpass FIR filter 
designed in Example 15.6 and the HR filters designed in Problem 16.15. 

16.25 Compare the implementation complexity of the bandstop FIR filter 
designed in Example 15.7 and the HR filters designed in Problem 16.16. 

16.26 Using the Matlab, filter design function, confirm the transfer func- 
tions derived in Problems 16.10-16.16. 


CHAPTER 



Applications of digital signal 
processing 


With the increasing availability of digital computers and specialized digital 
hardware, digital signal processing offers a cost-effective alternative to many 
traditional analog signal processing applications. The digital approach is par- 
ticularly attractive due to its adaptability and immunity to variations in the 
operating conditions. Since the operation of digital systems does not depend 
upon the exact value of the input signals or the constituent digital components, 
digital signal processing allows precise replication where the same operation 
can be repeated a large number of times, if required. In contrast, analog signal 
processing suffers from deviations caused by degradation in the performance 
of the analog components and changes in the operating conditions. Digital 
implementations are also adaptable to changes in the specifications of the 
system. By modifying the software, different specifications can be implemented 
by the same digital hardware. An analog system, on the other hand, has to be 
redesigned every time the specifications of the system change. 

This chapter reviews elementary applications of digital signal processing 
in the field of spectral estimation, audio and musical signal processing, and 
image processing. Our aim is to motivate readers to explore the use of digital 
signal processing in applications of interest to them. Section 17.1 introduces 
spectral estimation, in which the spectral content of a non-stationary signal is 
estimated from a limited number of signal realizations. Sections 17.2, 17.3, and 
17.4 consider audio signal processing, including spectral estimation, filtering, 
and compression of audio signals. As an example of multidimensional signal 
processing, we consider digital image processing in Sections 17.5, 17.6, and 
17.7. Finally, Section 17.8 concludes the chapter with a summary of important 
concepts. 


17.1 Spectral estimation 
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Estimating the frequency content of a signal, commonly referred to as spec- 
tral analysis or spectral estimation, is an important step in signal processing 
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Fig. 17.1. DFT used to estimate 
the frequency content of 
stationary and non-stationary 
signals in Example 17.1. 

(a) Magnitude sepctrum of 
Xj [At], (b) Enlarged version of 
part (a) in the frequency range 
— 0.05jt < Q < 0.05rr. 

(c) Magnitude spectrum of 
x 2 [k], (d) Enlarged version of 
part (c) in the frequency range 
— 0.27T < Q < 0.27T. 


applications. For most signals of interest, the discrete Fourier transform (DFT) 
provides a convenient approach for spectral estimation. Example 17.1 highlights 
the DFT-based approach for two test signals. 

Example 17.1 

Using the DTFT, estimate the spectral content of the following DT signals: 

(a) xi[£] = cos(0.0l7r£) + 2 cos(0.0157tA:); 

(b) x 2 [k] = cos(0.000l7r£ 2 ), 

from observations made over the interval 0 < k < 1000. 


Solution 

(a) The magnitude spectrum of jci [A:] based on the DFT is plotted over the 
frequency range — jr < <7 < it in Fig. 17.1(a) with the magnified version 
shown in Fig. 17.1(b), where the frequency range —0.05^ < <7 < 0.057T 
is enhanced. By looking at the peak values in Fig. 17.1(b), it is clear that 
the frequencies T? j = 0.017T and f} 2 — 0.01577 radians/s are the dominant 
frequencies in the signal. On a relative scale, the frequency component f] 2 = 
0.015tt has a higher strength compared with the frequency component 

= O.OItt. 

(b) The magnitude spectrum of x 2 [k] based on the DFT over the frequency 
range — n < f? < n is plotted in Fig. 17.1(c), with the magnified version 
shown in Fig. 17.1(d), where the frequency range —0.2n < <2 < 0.2tz is 
enhanced. From the subplots, it seems that all frequencies within the range 
— 0.27T < fi < 0.2 7t are fairly significant in x 2 [k]. To confirm the validity 
of our estimation, let us calculate the instantaneous frequency of the signal. 
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Note that the phase of * 2 [A:] is given by 6q = 0.000l7rk 2 . By differentiating 
the phase Oq with respect to k, the instantaneous frequency is obtained as 
coq = 0.0002jtk. The instantaneous frequency too is a function of time k, 
and increases proportionately as k increases. However, this time-varying 
nature of the frequency is not obvious from the magnitude spectrum shown 
in Fig. 17.1(c). Since the DFT averages the frequency components over all 
time k, the DFT provides a misleading result in this case. 

Example 17.1 shows that the DFT magnitude spectrum based approach is 
convenient for estimating the spectral content of a stationary signal comprising 
sinusoidal components with fixed frequencies. However, it may provide mis- 
leading results for non-stationary signals, where the instantaneous frequency 
changes with time. In other words, it is difficult to visualize the time evolution 
of frequency in the DFT magnitude spectrum. The short-time Fourier transform 
is defined in Section 17.1.1 to address this limitation of DFT. 


In order to estimate the time evolution of the frequency components present in 
a signal, the short-time Fourier transform (STFT) parses the signal into smaller 
segments. The DFT of each segment is calculated separately and plotted as a 
function of time k. The STFT is therefore a function of both frequency 17 and 
time k. Mathematically, the STFT of a DT signal x[k] is defined as follows: 


where the subscript s in X s (f2, b) denotes the STFT and b indicates the amount 
of shift in the time-localized window g[k] along the time axis. Typical windows 
used to calculate the STFT are rectangular, Hanning, Hamming, Blackman, and 
Kaiser windows. Compared to the rectangular window, the tapered windows, 
such as Hanning and Blackman, reduce the amount of ripple and are generally 
preferred. 

In most cases, the time shift b is selected such that successive STFTs are taken 
over adjacent samples of x[k] and there is some overlap of samples between 
successive STFTs. As discussed earlier, the STFT is a function of two variables: 
the frequency i? and the central location of the window. It is typically plotted 
as an image plot, known as a spectrogram, with frequency fl varying along 
the y-axis and the time (i.e. the center of the window function) varying along 
the x-axis. The intensity values of the image plot show the relative strength of 
various frequency components in the original signal. 


17.1.1 Short-time Fourier transform 


oo 



(17.1) 


k=—oo 


Example 17.2 

Plot the spectrogram of the signal X 2 [k] = cosfO.OOO I irk 2 ) for duration 
k = [0, 39 999], 
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Solution 

In order to calculate the STFT, let us choose the Hanning window function of 
length N w = 901 samples to parse the data sequence of length N s = 40000. 
Further assume that the overlap N a between two consecutive windows to be 
N 0 = 600 samples. The total number of complete windows is given by 


M = 


N s -N 0 
N w - N 0 


= 130. 


(17.2) 


The p — 0 window is centered at sample k = 450; the p — I window is centered 
at 450 + (901 — 600) = 751; the p = 2 window is centered at 750 + (901 — 
600) = 1052. In general, a window p is centered at 

k = Nw ~ 1 + p(N w - N 0 ) = 450 + 301/; (17.3) 

for 0 < p < 129. To obtain improved resolution in the frequency domain and to 
use the FFT algorithm efficiently, we zero-pad each time-windowed signal by 
123 zero samples to make the total length of each segment equal 1024, which 
is a power of 2. 

Note that the DFT of each zero-padded time-windowed signal will have a 
total of 1024 coefficients in the frequency domain. As the signal is real, the 
DFT coefficients will satisfy the Hermitian symmetry property. In other words, 
the amplitude spectrum is even-symmetric and we can ignore the second half 
of the spectrum which corresponds to the negative frequencies. So, we choose 
the first 513 coefficients out of a total of 1024 DFT coefficients corresponding 
to each windowed signal. The spectrogram is therefore a 2D matrix of size 513 
x 130 samples. Each of the 130 columns will represent the amplitude spectrum 
of the signal at the time instant given by Eq. (17.3). Each row contains the 
amplitude of the 513 DFT coefficients. Note that the first coefficient ( r = 0) 
represents frequency fl = 0 and the last (r = 512) coefficient represents fre- 
quency H — 7 r, with the intermediate frequencies given by 


f2 r = — xn (17.4) 

512 

for 0 < r < 512. The resulting spectrogram is shown in Fig. 17.2, where the 
black intensity points represent lower magnitudes and the light intensity points 
represent higher magnitudes. Note that the spectrogram is wrapped around the 
frequency range [0, it]. Figure 17.2 illustrates that the frequency of the chirp 
signal increases linearly with time. 

In Example 17.2, we selected values for the window length and the overlap 
period on an ad hoc basis. The choice of the window size is important as it 
provides a trade-off between the resolution obtained in the frequency domain 
and the localization in the time domain. A larger window allows us to observe 
a signal for a longer period of time before we calculate the DFT. As a result, it 
provides a higher frequency resolution in the spectrogram. On the other hand, a 
shorter time window provides a better localization in time but a poor frequency 
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Fig. 17.2. Spectrogram of o 

the chirp signal . j 
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from Example 17.2. 
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resolution. A longer window, therefore, generates a narrow-band spectrogram 
while a shorter window generates a wide-band spectrogram. Similarly, the over- 
lap chosen between two consecutive windows provides continuity and reduces 
sharp transitions in the spectrogram. 


17.1.2 Spectrogram computation using Matlab 

In Matlab , the signal processing toolbox includes the function specgram 
for calculating the spectrogram of a signal. The spectrogram in Example 17.2 
is computed using the following code: 

» k = [0:39999] ; 

>> x2= cos ( 0 . 0001*pi*k . *k) ; 

>> Fs = 1 ; 

>> Nwind = 901; Nfft = 1024; Noverlap = 600; 

>> [spgram, F, T] = specgram(x2, Nfft, Fs, hanning (Nwind) , 
Noverlap) ; 

>> imagesc([0 length (x2 ) /Fs ] , 2*pi*F, 

20*logl0 (abs (spgram) + eps) ) ; 

>> colormap (gray) 

The Matlab function imagesc displays the spectrogram using a color map. 
We can set the color map to gray using the last command in the code. 


17.1.3 Random signals 

The signals that we have studied so far are referred to as deterministic signals. 
Such signals can be specified by unique mathematical expressions, allowing us 
to calculate them precisely for all time. A second category consists of signals 
that cannot be predicted precisely in advance, which are collectively referred 
to as random or stochastic signals. Individual values of stochastic signals carry 
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little information, and therefore statistical averages such as mean, autocor- 
relation, and power spectral density are commonly used to specify stochastic 
signals. We start by defining the statistical mean and autocorrelation commonly 
used to define a stochastic signal. If x[k], x [&i ] , x[k 2 \ are discrete random vari- 
ables taking on values from the set {x m , — oc < m < 00 } at times k, k\, and k 2 , 
respectively, the mean and autocorrelation functions are defined as follows: 

CO 

mean Zsfxl/:]} = E x m P[x[k]= x m ]-, (17.5) 

m =— 00 

autocorrelation P xx [k \ , k 2 \ = E{x[ki\x[k 2 ]} 

OO OO 

= ^2 T. x m x n P[x[ki\ = x m \ x[k 2 \ = x n ]. 

m=—oo n =— 00 

(17.6) 

In Eqs. (17.5) and (17.6), the operator E denotes the expectation and P[x[k\ = 
x m \ is the probability that x[k ] takes on the value x m . Likewise, P[x[k{\ = 
x m ; x[k 2 ] — x„ ] refers to the joint probability for random signals x [k\ ] and x [ k 2 \ 
observed at time instants k\ and k 2 . Estimating the mean and autocorrelation of 
a stochastic signal is difficult in general. In many applications, random signals 
satisfy the following two properties. 

(1) The mean £{x[A:]} is constant and independent of time. 

(2) The autocorrelation E{x[k\]x [k 2 ] } depends upon the duration between the 
observation instants k\ and k 2 . In other words, the autocorrelation is inde- 
pendent of the observation instants and is only determined by the duration 
between the two observations. 

Such signals are referred to as wide-sense stationary (WSS) random signals. 
Sometimes, these are referred to as weak-sense stationary or second-order sta- 
tionary random signals. Mathematically, the aforementioned two properties of 
the WSS signals can be expressed as follows: 

mean E{x[k]} = fx x ; (17.7) 

autocorrelation R xx [k\, ki\ = R X x[k\ — k 2 \ = R xx [m]. (17.8) 

The DTFT of the autocorrelation R xx [m\ of a WSS signal is referred to as the 
power spectral density, which is defined as follows: 

OO 

power spectral density S xx (17) = E (17.9) 

m=—o o 

Equations (17.8) and (17.9) are widely used to estimate the spectral content 
of WSS signals, and the equations require the probability density functions 
to estimate the spectral content, which is generally not known in most signal 
processing applications. In the following, we present a method, based on the 
periodogram, to estimate the spectral content of stochastic signals from a finite 
number of observations. 
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17.1.4 Periodogram 

The periodogram method is similar to the spectrogram method and exploits the 
STFT for spectrum estimation using a window function g[/c] of length /V w and 
centered at k = b. The time-windowed sequence Ub[k\, centered at k = b, is 
given by 

g[k], 0<*<(JV W -1). (17.10) 

The DFT of ui,[k] is given by 

tVw-i 

U b {Si) = Ub[k]e~> nk . (17.11) 

k=0 

The periodogram method estimates the power spectrum P XX (JT) using the fol- 
lowing equation: 

Pxx(0)= \\U b m 2 , (17.12) 

where p is referred to as the norm of the window function g [k] and is calculated 
as follows: 



While computing the STFT, different window functions attenuate the original 
samples of the signal x[k ] by different amounts. Inclusion of a scaling factor 
of l//x 2 in Eq. (17.12) reduces the bias introduced by a particular window 
function. 

If g[k ] is a rectangular window, the estimate of the power spectrum P XX (Q) 
computed with Eq. (17.12) is called the periodogram. For all other windows, 
the estimate is referred to as the modified periodogram. 

In its current form, Eq. (17.1 1) calculates the yV w - point DFT that produces 
DTFT values for a set of equally spaced /V w frequency points within the range 
fl = [0, 27r]. As for the spectrogram, we can zero-pad the time-windowed 
sequence and increase the DFT length to obtain a denser plot in the frequency 
domain. 


u b [k] — x 


k + b 


(Vw 

2 


17.1.5 Average periodogram 

To estimate the power spectrum, Eq. (17. 12) uses a single window with duration 
of 0 < k < < /V w — 1 ) within the input signal x[k\. Improved results are obtained 
if several estimates from different locations of the signal are obtained and 
the resulting values are averaged. Starting from duration 0 < k < < /V w — 1 ), 
the first iteration computes the periodogram from x[k ] within the specified 
duration. In the second iteration, the window is moved forward by (1V W - N a ) 
samples such that there is an overlap of N a between successive windows. The 
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new location of the window is given by (iV w — N 0 — l) < k < (2N W — N 0 — 
2) for the second iteration, which is used to compute the periodogram for the 
second duration. The process is repeated until the entire signal is parsed and 
the average value of the periodogram is selected as the estimate of the power 
spectrum. This method, based on averaging the values of the power spectrum 
obtained from different periodograms, is referred to as the Welch estimate of the 
periodogram. 

In the signal processing toolbox of Matlab, the built-in function psd 
estimates the power spectrum of a signal using the periodogram approach. The 
following example illustrates the use of the psd function. 

Example 17.3 

Estimate the power spectral density of the following signal: 

x[k] = 3cos(0.2jrfc) + 2cos(0.3jrifc) + r[ifc], (17.14) 

where r[k] is a white noise with Gaussian distribution with a variance of 4. 

Solution 

Note that the signal x[k ] includes a deterministic component consisting of 
the two sinusoids and a random component. The following code generates a 
realization of x [£] and estimates the power spectrum: 

» k = [0:6000] ; 

>> x = 3*cos (0 . 2*pi*k) + 2 *cos ( 0 . 4*pi*k) + 

2*randn (size (k) ) ; 

>> Fs = 2 ; nwind = length(x); 

>> nfft = length (x) ; noverlap = 0 ; 

>> [PxxNoAvg, F] = psd(x, nfft, Fs, rectwin (nwind) , 

>> noverlap); Fs = 2; nwind=301; 

>> nfft = 512; noverlap = floor ( 4*nwind/5 ) ; 

>> [PxxWelch, F] = psd(x, nfft, Fs, 
hanning (nwind) , noverlap) ; 

The random component r [A:] is generated using the Matlab function r andn. 
As the variance of the random component is 4, we multiply randn by the 
standard deviation, which equals 2. Figure 17.3 shows the first 201 samples of 
an example of x[k]. Over different simulations, the signal x | k ] may have slight 
variations due to the presence of the random component. 

The Matlab code computes the power spectrum in two ways. The first 
estimate PxxNoAvg represents the power spectrum obtained by calculating 
the DFT of the entire signal. Note that there is no averaging in this case. The 
second estimate, PxxWelch, represents the power spectrum obtained by the 
Welch method, where the signal is parsed into shorter sequences with a Hanning 
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(a) 

Fig. 17.3. Estimating the power 
spectrum of a random signal 
using the periodogram 
approach, (a) Original random 
signal, (b) Power spectrum 
obtained from periodogram with 
no averaging, (c) Power 
spectrum obtained from 
periodogram with overlap and 
averaging based on the Welch 
method. 


(b) 
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window of size 301 . Two consecutive windows have an overlap of 240 samples, 
resulting in a total of 94 data windows. Each of these sequences is zero-padded 
with 211 zero-valued samples and the DFT is calculated. The averaged power 
spectrum is then obtained by averaging all 94 power spectra. 

The resulting power spectra are shown in Figs. 1 7.3(b) and (c). Although both 
spectra exhibit peaks at 17 = 0.2;r and 0.47T the estimate PxxNoAvg contains a 
substantial amount of noise. Since the estimate PxxWelch averages the power 
spectrum, most of the noise is canceled out. However, averaging also reduces 
the magnitudes of peaks at 17 = 0.27T and 0.4 jt in PxxWelch. In the latter 
case, the peaks are not as pronounced as the peaks in PxxNoAvg. 


17.2 Digital audio 


Since the 1980s, digital audio has become a very popular multimedia format 
for several applications, including the audio CD, teleconferencing, and digital 
movies. With the enormous growth of the World Wide Web (WWW), audio 
processing techniques such as filtering, equalization, noise suppression, com- 
pression, and synthesis are being used increasingly. In this section, we focus 
on three aspects of audio processing: spectrum estimation, audio filtering, and 
audio compression. We start by discussing how audio is stored in files and 
played back in Matlab . 


17.2.1 Digital audio fundamentals 

Sound is a physical phenomenon induced by vibrations of physical matter, such 
as the excitation of a violin string, clapping of hands, and movement of our vocal 
tract. The vibrations in the matter are transferred to the surrounding air resulting 
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Fig. 17.4. Waveform of a digital 

1 

audio signal stored in the 

0.5 

testaudio1.wav file. 



v 0 
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in the propagation of pressure waves. The human auditory system processes 
the air waves and uses the information contained in the pressure variations to 
extract audio information from the wave. It is possible to process sound waves 
directly, as in a microphone, which converts sound to electrical signals that 
are amplified and played back using a loudspeaker. The term audio refers to 
electronically recorded or reproduced sound, while digital audio is obtained by 
the sampling and quantization of an analog audio signal. The waveform of an 
audio signal is shown in Fig. 17.4. 

An audio signal is described using two properties. The first property is pitch, 
which describes the shrillness of sound. Pitch is directly related to the fre- 
quency of the audio signal and the two terms are used interchangeably. The 
second property is the loudness, which measures the amplitude or intensity 
of the audio signal using the decibel (dB) scale. Generally, the audible inten- 
sity of an audio signal varies between 0 and 140 dB, where 0 dB represents 
the lower threshold of hearing, below which a human auditory system is inca- 
pable of hearing any sound. Typical office environments have an ambient audio 
level of about 70 dB. Audio above 120 dB is very loud and is injurious to 
humans. 

Sound generated from physical phenomena contains frequency in the range 
0-10 GHz. Since the human auditory system is only intelligible to sound fre- 
quencies between 20 Hz and 20 kHz, most audio signals record sound within 
this audible range and neglect any higher-frequency components. For example, 
the digital audio stored on an audio compact disc is obtained by filtering the 
CT audio by a lowpass filter with a cut-off frequency of 20 kHz, and the fil- 
tered signal is sampled using a sampling rate of 44.1 ksamples/s. The number 
of quantization levels used to produce digital audio depends upon the appli- 
cation and may vary from 4096 levels obtained with a 12-bit quantizer, to 65 
536 levels with a 16-bit quantizer, to 4 million levels with a 24-bit quantizer. 
Higher numbers of quantization levels result in lower distortion and more pre- 
cise reproduction of the original sound. 


17.2.2 Formats for storing digital audio 

Digital audio is available in a wide variety of formats, such as the au, wav, and 
mp3 formats. Both au and wav formats store audio in the uncompressed form, 
while mp3 compresses audio using Layer 3 of the MPEG- 1 audio compression 
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standard. In this section, we will focus on the au and wav formats. Typically, 
a digital audio file stored in the au format has an .au extension, while digital 
audio stored in the wav format has a .wav extension. 

Matlab provides a number of library functions to read and write audio 
files stored in the au and wav formats. For the au format, MATLAB provides the 
auread and auwrite functions to read and write an audio file, respectively. 
Likewise, the wavread and wavwrite functions are available to read and 
write an audio file in the wav format. The following code reads the audio file 
“testaudiol .wav” using the wavread function. There are three output 
arguments to the wavread function. The first argument x is an array where 
the audio signal is restored. For mono (single-channel) audio signals, x is a 
ID vector. For stereo (dual-channel) signals, x is a 2D array corresponding to 
the number of signals played by the two speakers. The second argument Fs 
represents the sampling rate, while nbit represents the number of bits per 
sample. 

>> %Reading the input audio file 

>> infile = 'f:\MATLAB\signal\ % audio file 

>> testaudiol.wav'; 

>> [x, Fs, nbit] = wavread ( inf ile) ; % x = signal 

% Fs = sampling rate 
% nbit = number of 
% bits per sample 

The above Matlab program will produce a ID array x with dimension 
26 079 x 1 . In other words, the audio signal is a mono signal and contains 26 079 
samples. The sampling rate is 22.05 ksamples/s and the signal is quantized using 
an 8-bit quantizer. The waveform of the audio signal stored in the testaudiol .wav 
file is shown in Fig. 17.4. To play the audio signal stored in x, we use the sound 
or soundsc function available in Matlab as follows: 

>> sound (x, Fs); 

The soundsc function normalizes the entries of vector x so that the sound is 
played as loud as possible without clipping. The mean value is also removed. 
After playing the vector x obtained from testaudiol .wav, you should 
recognize that the file contains the spoken word “audio.” Relating the word 
“audio” to Fig. 17.4, we observe that the waveform has three distinct segments. 
The first segment represents the syllable “au,” the second segment represents 
the syllable “di,” and the last segment represents “o.” Some silent intervals, 
represented by near-zero-amplitude waveforms, are also observed in the plot. 


17.2.3 Spectral analysis of speech signals 

In Section 17.1, we presented techniques for estimating the spectral content 
of a nonstationary signal. Audio signals such as speech, music, and ambient 
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Fig. 17.5. Spectrograms of the 
speech signal recorded in 
testaudiol .wav. 

(a) Narrow-band spectrogram; 

(b) wide-band spectrogram. 


sound are examples of non-stationary signals. Therefore, the techniques pre- 
sented in Section 17.1 can also be used to estimate the spectral content of audio 
signals. 

To calculate the spectrogram of the audio signal stored in testaudiol.wav, we 
use the following Matlab code: 


» %Reading the input audio file 
» infile = 'testaudiol.wav'; % audio file 

» [x, Fs, nbit] = wavread ( inf ile) ; % x = signal 

% Fs = sampling rate 
% nbit = number of 
% bits per sample 

» nfft = 1024; nwind = 1024; noverlap = 768; 

» [spgram,F,T] = specgram (x, nfft , Fs , hanning (nwind) , 
noverlap) ; 

» spgramdB = 20*logl0 (abs (spgram) + eps) ; 

>> imagesc([0 length (x)/Fs], 2*pi*F, spgrandB) ; 

>> colormap (gray) 


The above code calculates the spectrogram using a window size of 1024, shown 
in Fig. 17.5(a). As the window size is a power of 2, we choose to calculate the 
DFT without any zero padding. For the audio signal testaudiol .wav, the 
sampling rate of the signal is given by 22 050 samples/s. A window size of 
1024 samples therefore corresponds to a duration of 1024/22050 = 0.0461 s. 
Hence, the time resolution of the spectrogram is limited to 46 ms. 

The frequency resolution in the spectrogram plotted in Fig. 17.5(a) is obtained 
by dividing the sampling frequency by the total number of samples in the fre- 
quency domain, which gives 22 050/1024 = 21 .53 Hz. During the computation 
of the spectrogram, it is possible to trade-off time resolution for the frequency 
resolution, and vice versa. To improve the time resolution of the spectrogram 
in Fig. 17.5(a), we decrease the window size to 256 with an overlap of 128 
samples between two successive windows: 
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>> %Reading the input audio file 

>> infile = 'testaudiol.wav'; % audio file 

>> [x, Fs, nbit] = wavread ( inf ile) ; % x = signal 

% Fs = sampling rate 
% nbit = number of 
% bits per sample 

>> nfft = 256; nwind = 256; noverlap = 128; 

>> [spgram,F,T] = specgram (x, nf f t , Fs , hanning (nwind) , 
noverlap) ; 

>> spgramdB = 20*logl0 (abs (spgram) + eps); 

>> imagesc([0 length (x) /Fs] , 2*pi*F, spgrandB) ; 

>> colormap (gray) 

The resulting spectrogram is shown in Fig. 17.5(b). Choosing a window size of 
256 samples improves the time resolution to 11.6 ms. However, the frequency 
resolution is reduced to 22 050/256 = 86. 1 3 Hz. Comparing the two histograms 
in Fig. 17.5, we observe that the time resolution of Fig. 17.5(b) is better than that 
of Fig. 17.5(a). However, the improvement in the time resolution is obtained at 
the cost of the frequency resolution. Clearly, Fig. 17.5(b) has a relatively lower 
frequency resolution compared with that of Fig. 17.5(a). Therefore, Fig. 17.5(a), 
with a better frequency resolution, is considered a narrow-band spectrogram, 
whereas Fig. 17.5(b), with a lower frequency resolution, is considered a wide- 
band spectrogram. 


17.2.4 Power spectrum 

Using the techniques discussed in Section 17.1.5, the power spectrum of the 
speech signal stored in vector x obtained from the test audio 1 .wav file can 
be computed using the psd function available in Matlab as follows: 

>> nwind=512; nfft = 512; noverlap = f loor (3 *nwind/4 ) ; 

>> [Pxx, F] = psd(x, nfft, Fs, hanning (nwind) , noverlap) ; 

>> plot (F, 10*logl0 (Pxx) ) ; 

The resulting power spectrum is shown in Fig. 17.6, where we observe that 
most of the energy of the signal is concentrated in the frequency band 0-2 kHz. 


17.2.5 Spectral analysis of music signals 

In this section, we analyze the spectral content of the music signal stored in 
testaudio2 .wav using the spectrogram and periodogram methods. The 
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Fig. 17.6. Power spectrum of the 
speech signal stored in the 

testaudiol .wav file. 


17.3 Audio filtering 
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music signal is read using the following Matlab code and the resulting 
time-varying waveform of the music signal is plotted in Fig. 17.7(a): 

» %Reading the input audio file 

» infile = 'testaudio2.wav'; % audio file 

» [x, Fs, nbit] = wavread ( inf ile) ; % Fs = sampling rate, 

% nbit = # bits/sample 

» plot ( 1/Fs* [ 0 : length (x) -1] , x) ; 

» nfft=1024; nwind=1024 ; noverlap=512 ; 

» [spgram, F, T] = specgram (x, nf f t , Fs , hanning (nwind) 
noverlap) ; 

» imagesc([0 length (x) /Fs ] , F/1000, 20*logl0 

(abs (spgram) + eps) ) ; 

» colormap (gray) 

» [Pxx, F] = psd (x, nf f t , Fs , hanning (nwind) , noverlap) ; 

» plot (F, 10*logl0 (Pxx) ) ; 

The resulting spectrogram is shown in Fig. 17.7(b), where the horizontal axis 
represents time and the vertical axis represents frequency. As the speech signal 
is real-valued, the spectrum is plotted for the positive frequencies only. Since 
the bright intensity regions represent higher energy, it can be seen that the signal 
has most energy at the lower frequencies. 

The average periodogram of the music signal is plotted in Fig. 17.7(c). It is 
observed that the peak power of about 6.5 dB occurs at 100 Hz and that the 
power decreases as the frequency is increased. 


Frequency-selective filtering emphasizes certain frequency components by 
attenuating the remaining frequency components present in a signal. Four types 
of digital filters, namely lowpass, highpass, bandpass, and bandstop filters, were 
covered in Chapters 14-16. In this section, we process audio signals using these 
digital filters. 
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(a) 


Fig. 17.7. Frequency analysis of 
the music signal stored in the 
testaudio2 .wav file. 

(a) Time representation; 

(b) spectrogram; (c) power 
spectrum of the music signal. 


(b) 



(c) 


Example 17.4 

Consider the audio signal stored in the bell .wav file, which was sampled 
at a sampling rate of 22 050 samples/s and quantized using an 8-bit quantizer. 
The power spectral density, shown in Fig. 17.8(b), illustrates that the signal 
has frequency components across the entire 0-11 025 Hz frequency range. 
We now process the audio signal with the lowpass, highpass, and bandpass 
filters. 


Lowpass filtering A lowpass FIR filter with a cut-off frequency of 3 kHz and 
order 64 is designed using the f irl Matlab library function. The following 
Matlab code designs the lowpass filter: 

>> filtLow = f irl ( 64 , 3 000 / 

(Fs/2 ) ) ; 

>> w = 0 : 0 . 001*pi :pi ; 

>> HLpf = f reqz ( filtLow, 1 , w) ; 

>> plot (w*Fs/ (2*pi) , 20*logl0 
(abs(HLpf) + eps) ) ; 

By default, the firl function uses the Hamming window. Since the firl 
function accepts normalized frequencies, the cut-off frequency is normalized 
with half the sampling frequency. The magnitude spectrum of the resulting 
lowpass filter is shown in Fig. 17.9(a). 


% Filter: Order = 64 
% cutoff = 3kHz 
% discrete frequencies for 
% spectrum 
% transfer function 
% magnitude spectrum 
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Fig. 17.8. Audio signal stored in 
the be 1 1 . wav file, (a) Time 
representation; (b) power 
spectrum. 


To derive the output of the lowpass filter when the audio signal stored in 
bell .wav is applied at the input of the filter, the following Matlab code 
is used: 


>> xLpf = f ilter ( f iltLow, 1 , x) ; % Lowpass filtered audio 

% signal 


To hear the resulting audio signal and plot its power spectrum, we use the 
following Matlab code: 


Fig. 17.9. Lowpass filtering of 
the audio signal stored in the 
bell .wav file, (a) Frequency 
characteristics of a 64-tap FIR 
lowpass filter designed using a 
Hamming window with a cut-off 
frequency of 3000 Hz. 

(b) Power spectrum of the 
filtered signal. 


» soundfxLpf , Fs) ; % Play filtered sound 

» nfft=1024; nwind=1024 ; noverlap=512 ; 

» [Pxx, F] = psd (xLpf , nf f t , Fs , hanning (nwind) , noverlap) ; 
» plot (F, 10*logl0 (Pxx) ) ; 


Listening to the lowpass filtered sound, we observe that the sound is less shrill 
with a lower pitch. This is also apparent from the power spectrum shown in Fig. 
17.9(b), where we observe that the frequency components above 3 kHz have 
a much lower magnitude than the corresponding frequency components of the 
original bell sound. 
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Fig. 17.10. Bandpass filtering of 
the audio signal stored in the 
bell .wav file, (a) Frequency 
characteristics of a 64-tap FIR 
bandpass filter designed using a 
Hamming window with cut-off 
frequencies of 2000 and 
5000 Hz. (b) Power spectrum of 
the filtered signal. 


Bandpass filtering As was the case for the lowpass filter, we design the band- 
pass filter using the f irl command. The Matlab code is given below. 


» f Bp = firl (64, [2000 
5000] / (Fs/2) ) ; 

>> w = 0 : 0 . 001*pi :pi ; 


>> HBpf = freqz (fBp, l,w) ; 
>> plot (w*Fs/ (2*pi) , 20*log 
10(abs(HBpf) + eps)); 


%Filter: order = 64 
% cutoff = [2 5] kHz 
% discrete frequencies for 
% spectrum 
% transfer function 

% magnitude spectrum 


The magnitude spectrum of the bandpass filter is plotted in Fig. 17. 10(a), which 
filters the bell sound using the following Matlab code: 


>> xBpf = filter (fBp, l,x) ; % Bandpass filtered audio 

% signal 

>> sound (xBpf , Fs ) ; % Play filtered sound 

>> nfft = 1024; nwind=1024 ; noverlap=512 

>> [Pxx, F] = psd (xBpf , nf f t , Fs , hanning (nwind) , noverlap) ; 
>> plot (F, 10*logl0 (Pxx + eps)); 


The power spectrum of the resulting bandpass signal is plotted in Fig. 17. 10(b). 
We see that the frequency components within the pass band of [2000 5000] Hz 
are retained in the filtered signal. The remaining frequency components are 
attenuated by the bandpass filter. 


Highpass filtering The highpass filter with a cut-off frequency of 4 kHz is 
designed using the following Matlab code: 

» f Hp = firl (64, 4000/ (Fs/2) , 'high' ) ; 

% Filter: order = 64 
% cutoff = 4kHz 

>> w = 0 : 0 . 001*pi :pi ; % discrete frequencies for 

% spectrum 
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Fig. 17.11. Highpass filtering of 
the audio signal stored in the 
bell .wav file, (a) Frequency 
characteristics of a 64-tap FIR 
highpass filter, with cut-off 
frequency of 4000 Hz, designed 
using a Hamming window. 

(b) Power spectrum of the 
filtered signal. 


» HHpf = f reqz ( fHp, 1 , w) ; % transfer function 

» plot (w*Fs/ (2*pi) , 20*logl0 % magnitude spectrum 
(abs(HHpf) + eps)); 

The magnitude spectrum of the highpass filter is plotted in Fig. 17.1 1(a), which 
filters the bell sound using the following code: 

>> xHpf = f ilter ( fHp , 1 , x) ; % Highpass filtered audio 

% signal 

>> sound (xHpf , Fs) % play the sound 

>> nfft=1024; nwind=1024 ; noverlap=512 ; 

>> [Pxx, F] = psd (xHpf , nf f t , Fs , hanning (nwind) , noverlap) ; 
>> plot (F, 10*logl0 (Pxx + eps) ) ; 


The power spectrum of the highpass filtered signal is shown in Fig. 17.11(b), 
where we observe that the frequency components below 4 kHz are strongly 
attenuated. The higher frequency components are left unattenuated. The obser- 
vation is confirmed on playing the filtered sound, which sounds shriller, with a 
higher pitch than the original bell sound. 

Example 17.4 demonstrates the effects of lowpass, bandpass, and highpass 
filtering on an audio signal. The following example uses a bandstop filter to 
eliminate noise from a noisy signal. 


Example 17.5 

Consider the audio signal stored in the testaudio3 . wav file with the time- 
domain representation shown in Fig. 17.12(a). The audio signal is sampled at 
a sampling rate of 22 050 samples/s. Using the average periodogram method 
discussed in Section 17.1.5, the power spectral density of the audio signal 
is estimated and plotted in Fig. 17.12(b). From the power spectral density 
plot, we observe that there is a sharp peak at 8 kHz, which is identified as 
noise corrupting the audio signal. The noise can be heard if we play the audio 
signal. 

To suppress the noise, we use a bandstop filter of order 128 with a stop band 
that ranges from 7800-8200 Hz. The order of the bandstop filter is chosen 
arbitrarily in this example. In more sophisticated applications, the order is 
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Fig. 17.12. Noise-corrupted 
signal stored in the 

testaudio3 .wav file. 

(a) Time representation; 

(b) power spectrum. 


computed from the amount of attenuation required within the stop band. Using 
M ATL AB , the transfer function of the bandpass filter is computed as follows: 


» wc =[7800 82001/11025; 

>> fBs = firl (128, wc, 'stop' ) ; 
>> w = 0 : 0 . 001*pi :pi ; 

>> HBs = freqz (fBs, l,w) ; 

>> plot (w*Fs/ (2*pi) , 20*logl0 


% Normalized cutoff 
% frequency 

% order-128 filter, 129 tap 
% discrete frequencies 
% for spectrum 
% transfer function 
(abs (HBs) ) ) ; 

% magnitude spectrum 


The magnitude spectrum of the resulting bandstop filter is plotted in Fig. 
17.13(a), which shows strong attenuation at 8 kHz. The gain at the remain- 
ing frequencies is close to unity. The noisy signal is filtered with the bandstop 
filter and the power spectral density of the filtered signal is calculated using the 
following M ATL A B code: 


Fig. 17.13. Bandstop filtering to 
eliminate noise from the noise 
corrupted signal shown in Fig. 
17.12. (a) Frequency 
characteristics of a 129-tap FIR 
bandstop filter, with cut-off 
frequencies of [7800 8200] Hz, 
designed using a Hamming 
windor. (b) Power spectrum of 
the filtered signal. 


>> xBsf = filter (fBs, l,x) ; % Bandstop filtered audio 

% signal 

>> nfft = 1024; nwind=1024 ,- noverlap=512 ,- 

>> [Pxx, F] = psd (xBsf , nf f t , Fs , hanning (nwind) , noverlap) ; 
>> plot (F, 10*logl0 (Pxx) ) ; 

The power spectral density of the filtered output is shown in Fig. 17.13(b), 
which shows a strong attenuation in the noise impulse present at 8 kHz. On 
playing the filtered signal, we observe that the effects of the noise have been 
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Fig. 17.14. Bandstop filtering to 
eliminate noise from the 
noise-corrupted signal shown in 
Fig. 17.12. (a) Frequency 
characteristics of a 201 -tap FIR 
bandstop filter, with cut-off 
frequencies of [7800 8200] Hz, 
designed using a Hamming 
window, (b) Power spectrum of 
the filtered signal. 


reduced, but not completely eliminated. Therefore, we increase the order of the 
bandstop FIR filter to 200. Using the above code with the order set to 200, we 
compute the impulse response of the 201 -tap bandstop FIR filter. The magnitude 
spectrum of the filter is plotted in Fig. 17.14(a). The power spectral density of 
the filtered signal obtained from the 201 -tap bandstop filter is shown in Fig. 
17.14(b). On playing the filtered signal, we observe that the noise component 
has been successfully suppressed. However, the suppression of noise is at the 
cost of eliminating certain frequency components which neighbor the frequency 
of the impulse noise. 


17.4 Digital audio compression 


Audio data in the raw format requires a large number of bits for repre- 
sentation. For example, the CD-quality stereo audio requires a data rate of 
176.4 kbytes/s for transmission or storage. This data rate is not supported by 
many networks, including the internet, hence real-time audio applications can- 
not be supported if the audio data are transmitted in the raw format. Similarly, 
storing at a data rate of 176.4 kbytes/s requires a large storage capacity, even to 
save a five-minute session. Compressing audio is therefore imperative for real- 
time audio transmission or for storing an audio session of meaningful length. 
Audio compression is defined as the process through which digital audio can 
be represented by a lower number of bits. Most compression techniques can be 
classified into two categories, namely lossy compression and lossless compres- 
sion. While lossless techniques are ideal as they allow perfect reconstruction 
of audio, they limit the amount of compression that can be achieved. Lossy 
techniques exploit the psychoacoustic characteristics of the human auditory 
system and achieve higher compression by eliminating audio components that 
are not audible to humans. In this section, we present the basic principles of 
audio compression. Example 17.6 emphasizes the need for audio compression. 

Example 17.6 

(a) A stereo (dual-channel) audio signal is to be transmitted through a 56 kbps 
network in real time. If the sampling rate of the digital audio signal is 
22.05 ksamples/s, what is the maximum average number of bits that can be 
used to represent an audio sample? 
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(b) If the quantizer uses 8 bits/sample for each channel, what is the maximum 
allowable sampling rate such that the audio signal can be transmitted over 
a 56 kbps network? 

(c) Calculate the compression ratio required to transmit the stereo audio signal 
through a 56 kbps channel if the sampling rate is given by 22.05 ksamples/s 
and the quantizer uses 8 bits/sample. 

Solution 

(a) Assuming that the quantizer uses n bits to represent each sample, 

number of bits produced per second = n bits/sample x 22050 samples/s 

x 2 channels = 44 100 n bps 

Equating this with the transmission rate of 56 kbps, we obtain 
n = 56 000/44 100 = 1.27 bits/sample. 

(b) Assuming that the sampling rate is given by / s samples/s, 

number of bits produced per second = 8 bits/sample x / s samples/s 

x 2 channels = 16/ s bits/s. 

Equating this with the transmission rate of 56 kbps, we obtain 
f s = 56 000/16 = 3500 samples/s. 

(c) To determine the compression ratio, we first calculate the number of bits 
produced per second: 

number of bits produced per second = 8 bits/sample x 22 050 samples/s 

x 2 channels = 352 800 samples/s. 

The compression ratio is therefore given by 

number of bits per second in the raw data 

compression ratio = 

number of bits per second in the compressed data 

352 800 


Example 17.6 demonstrates that digital audio can be transmitted over a low- 
capacity transmission channel in real time using three different approaches. 
The first approach reduces the number of bits used to represent each sample. 
This approach is not useful as it reduces the number of quantization levels 
such that considerable distortion is introduced into the transmitted audio. The 
second approach uses a low sampling rate, which is not practical as the sampling 
rate is dependent on the maximum frequency present in the audio signal. The 
maximum frequency of the audio signal can be reduced by lowpass filtering, 
but this will again introduce distortion. The third approach compresses the raw 
audio data. Compression of digital audio is achieved by eliminating redundancy 
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present in a signal. There are primarily three types of redundancies present in 
an audio signal that may be exploited. 

Statistical redundancy In most audio signals, samples with lower magnitudes 
have a higher probability of occurrence than samples with higher magnitude. In 
such cases, an entropy coding scheme, such as the Huffman code, can be used 
to allocate fewer bits to frequently occurring values and a higher number of 
bits to the other values. This reduces the bit rate for representing audio signals 
when compared with a coding scheme with an equal number of bits allocated 
per sample. 

Temporal redundancy Neighboring audio samples typically have a strong 
correlation between themselves such that the value of a sample can be predicted 
with fairly high accuracy from the last few sample values. Predictive coding 
schemes exploit this temporal redundancy by subtracting the predicted value 
from the actual sample value. The resulting difference signal is then compressed 
using an entropy based coding scheme, such as the dictionary or Huffman codes. 

Psychoacoustics redundancy There are many idiosyncrasies in the human 
auditory system. For example, the sensitivity of the human auditory system is 
maximum for frequencies within the 2000-4000 Hz band and the sensitivity 
decreases above or below this band. In addition, a strong frequency component 
masks the neighboring weaker frequency components. The unequal frequency 
sensitivity and masking properties are exploited to compress the audio. 

In the following section, we present a simplified audio compression technique, 
known as the differential pulse-code modulation (DPCM) technique. To achieve 
compression, the DPCM reduces the temporal redundancy present in an audio 
signal. 

17.4.1 Differential pulse-code modulation 

Most audio signals encoded with pulse-code modulation (PCM) exhibit a strong 
correlation between neighboring samples. This is especially true if the signal is 
sampled above the Nyquist sampling rate. Figure 17.15 plots 30 samples of an 
audio signal stored in the chord.wav hie. We observe that the neighboring 
samples are correlated such that their values are fairly close to each other. In 
DPCM, an audio sample ,v[A' | is predicted from the past samples. An M-order 
predictor calculates the predicted value of an audio sample at time instant k 
using the following equation: 

M 

.5 [A] = y ^ a m s[k — m], (17.15) 

m = 1 

where s[k - m] is the value of the audio sample at time instant k — m and a m 
are the predictor coefficients. The DPCM encoder quantizes the prediction 
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Fig. 17.15. Selected samples 
(sample 700 to 730) of the 
audio signal stored in the 
chord . wav file. The 
neighboring samples exhibit a 
strong correlation between 
themselves. 



error as follows: 


M 

e[k~\ = s[A:] — a m s[k — m], (17.16) 

m = t 

which is followed by a lossless entropy coding scheme. The DPCM decoder 
takes the inverse of the above steps in the reverse order. Since the actual sample 
values s[k — in] are not accessible at the decoder, the decoder uses the recon- 
structed values. In order to use the same prediction model at the encoder and 
decoder, Eq. (17.16) is modified as follows: 

M 

e[k] = s[£] - a ms'[k - m], (17.17) 

m= 1 


Fig. 17.16. Schematic of 
differential pulse-code 
modulator used for lossy 
compression, (a) DPCM encoder 
used to compress a signal; 

(b) DPCM decoder used to 
reconstruct a signal. The 
difference e[Ar] between the 
original input signal 5[/r] and its 
predicted value s[Ar]is quantized 
and transmitted to the receiver. 


where s'[k — m] is the reconstructed value of the audio sample s[k — m). The 
values of the predictor coefficients a m are usually estimated based on a max- 
imum likelihood (ML) estimator. Alternatively, a universal prediction model 
may be used where the predictor coefficients are kept constant for different audio 
signals. Examples of the universal prediction models include the following: 

first-order prediction model 5[k] = 0.97.v'[k — 1]; (17.18) 

second-order prediction model £[k] = 1.85'[k — 1] — 0.84v'[A: — 2]; (17.19) 

third-order prediction model S [A: ] = \.2s'[k — 1] + 0.5.v'[T — 2] 

— 0.78s'[k — 3]. (17.20) 



compressed audio 
e[k] 


(a) 


compressed audio 

e’l k] 



reconstructed audio 
s'[fe] 


(b) 
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The block diagrams of DPCM encoding and decoding systems are shown in 
Fig. 17.16. Example 17.7 illustrates various steps of the DPCM coding. 

Example 17.7 

Assume that the first four samples of a digital audio sequence are given by [70, 
75, 80, 82]. The audio samples are encoded using DPCM with the first-order 
predictor defined in Eq. (17.18). The error samples obtained by subtracting the 
predicted sample values from the actual audio sample values are divided by a 
quantization factor of 2 and then rounded to the nearest integer. Determine the 
values of the reconstructed signal. 

Solution 

In DPCM, the first sample value is encoded independent of other samples in 
the sequence. In this example, we assume that the first audio sample, at k = 0, 
with a value of 70 is encoded without any quantization error. In other words, 
e[0] = e[0] = 0 and the reconstructed sample value + [0] = 70. 

At k = 1 , the predicted sample, the associated error, and the quantized error 
are given by 

predicted value S[l] = 0.97 x 70 = 67.9; 

error e[l] = 75 - 67.9 = 7.1; 

quantized error e[l] = round(7.1/2) = 4. 

The reconstructed value of the sample at k = 1 is therefore given by 

s'[ 1] = 0.97 x 70 + 4 x 2 = 75.9. 

At k = 2, the predicted sample, the associated error, and the quantized error 
are given by 

predicted value s[2] = 0.97 x 75.9 = 73.623; 

error e[2\ = 80 - 73.623 = 6.377; 

quantized error e[2] — round(6. 377/2) = 3. 

The reconstructed value of the sample at k — 2 is therefore given by 

s'[ 2] = 0.97 x 75.9 + 3 x 2 = 79.623. 

At k = 3, the predicted sample, the associated error, and the quantized error 
are given by 

predicted value s[ 3] = 0.97 x 79.623 = 77.2343; 
error e[3] = 82 - 77.2343 = 4.7657; 

e[3] = round(4. 7657/2) = 2. 


quantized error 
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Table 17.1. Various steps of DPCM coding for Example 17.7 




Time index, k 


0 

1 

2 

3 

Original signal, s[7] 

70 

75 

80 

82 

Error signal, e[k] 

0 

75 - 67.9 = 7.1 

80 - 3.6 = 6.4 

82 - 7.2 = 4.8 

Quantized error signal, e[k] 

0 

7.1/2 = 4 

6.4/2 = 3 

4.8/2 = 2 

Reconstructed error 

0 

4x2 = 8 

3x2 = 6 

2x2 = 4 

Reconstructed signal, s'\k] 

70 

67.9 + 8 = 75.9 

73.6 + 6 = 79.6 

77.2 + 4 = 81.2 

Reconstruction error 

0 

-0.9 

0.4 

0.8 

Predicted signal for next sample 

70 x 0.97= 67.9 

75.9 x 0.97= 73.6 

79.6 x 0.97= 77.2 

81.2 x 0.97= 78.8 


The reconstructed value of the sample at k — 2 is therefore given by 
s'[3] = 77.2343 + 2 x 2 = 81.2343. 

The values of the audio samples reconstructed from DPCM are given by 
[70, 75.9,79.623,81.2343], 

which implies that the following distortion is introduced by DPCM: 

[0, -0.9,0.377,0.7657], 

The above steps are summarized in Table 17.1. The third row contains the 
quantized values of the error signal, which is compressed with a lossless scheme 
and transmitted to the receiver. 


17.4.2 Audio compression standards 

The DPCM compression scheme, as described in Section 17.4.1, is a primitive 
audio compression method that provides a low compression ratio. Several more 
efficient compression techniques have been developed since the 1980s. In order 
to achieve compatibility between the compressed bit streams, several audio 
compression standards have been developed by the International Organiza- 
tion for Standardization (ISO) and the International Telecommunication Union 
(ITU). These audio compression standards can be broadly classified into two 
categories: the low-bit-rate audio coders for telephony, such as G.711, G.722, 
and G.729 developed by the ITU, and the general-purpose high-fidelity audio 
coders, such as the moving pictures expert group (MPEG) audio standards, 
developed by the ISO and included in MPEG-1, MPEG-2, and MPEG-4. 

The ISO standards are generic audio compression standards designed for 
general-purpose audio. These standards provide a trade-off between compres- 
sion ratio and quality. For example, the MPEG- 1 audio algorithm has three lay- 
ers. Layer 1 is the simplest algorithm and provides moderate compression. Layer 
2 has moderate complexity and provides a higher compression than Layer 1 . 
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Layer 3 has the highest complexity and provides the best performance. Note 
that the MPEG- 1 Layer 3 standard is also referred to as the MP3 standard. 

In addition to the ITU G.7xx and ISO MPEG standards, a few other standards 
have been developed. For example, Dolby Laboratories have developed multi- 
channel high-fidelity audio coding standards such as AC-2 and AC-3 coders. 
The AC-3 standard has been adopted in the standard and high-definition digital 
television standard in North America. Readers are referred to more advanced 
texts for details on audio compression standards. 


17.5 Digital images 


Digital images have become a part of our daily lives. In this section, we present 
a brief overview of digital images and the techniques used to represent them. 


17.5.1 Image fundamentals 

A still monochrome image is defined in terms of its intensity or brightness i 
as a function of the spatial coordinates ( x , y). A still image is, therefore, a 2D 
function i(x, y). For analog images, coordinates ( x , y) have a continuous value. 

A discrete image i[m, n] is obtained by sampling the intensity i (x , y) along a 
rectangular grid M = [m Ax, n Ay] with resolutions of Ax along the horizontal 
axis and Ay along the vertical axis. Each discrete point [m Ax , n Ay] along the 
rectangular grid is referred to as a picture element, or pixel. A digital image 
i[m, n] is an extension of the discrete image, where the intensity i is quantized 
by a uniform quantizer. The number of quantization levels varies from one 
application to another and depends upon the precision required. Most digital 
images are quantized using an 8-bit quantizer, leading to 1 28 quantization levels. 
Medical images require higher precision and are quantized using a 12- or 16-bit 
quantizer. Color images are further extensions of discrete images, where the 
intensities of the three primary colors are measured at each pixel. Color images 
are therefore represented in terms of three components r[m, n ] , g[m, n\, and 
b[m, n ], where intensities are denoted by r[m, n] for red, g[m , n] for green, 
and b[m, n] for blue. 

As an example of still images, the back cover of this book illustrates a 450 x 
366 pixel test image, referred to as “train,” using three different quantization 
levels. The first figure shows the train image in the black and white (B W) format, 
where a single bit is used to represent each pixel. Bit 0 represents the lowest 
intensity (black), while bit 1 represents the highest intensity (white). The total 
number of bits used to represent the BW image is given by 1 bit/pixel x (450 x 
366) pixels = 164 700 bits. To provide more details, the second figure uses 8-bit 
quantization for each pixel, leading to a total number of 8 bit/pixel x (450 x 
366) pixels = 1 317 600 bits. The third figure shows the train image in the color 
format, where each pixel is represented in terms of the intensities of the three 
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primary colors. The color representation of the train image requires 8 bit/color x 
3 color/pixel x (450 x 366) pixels = 3 952 800 bits. 

A final extension of discrete images is obtained by measuring the color 
intensities r[m , ri], g[m, ri], and b[m, n] at discrete time k. Exploiting the 
persistence of vision and showing continuously recorded images at a uniform 
rate provides the impression of a video. A digital video is therefore defined 
in terms of the three color components r[m, n , k], g[m, n, k], and b[m, n, k]. 
In this section, we limit ourselves to 8-bit, monochrome, still images i[rn, ri]. 
However, the techniques are generalizable to color images and videos. 


17.5.2 Sampling of coordinates 

Chapter 9 defined the Nyquist rate as the minimum sampling rate that can be 
used to sample a time-varying CT signal without introducing any distortion 
during reconstruction. For a baseband signal, the Nyquist rate is twice the 
maximum frequency present in the signal. For analog images, the principle 
can be extended to the spatial coordinates (x, y) in two dimensions to obtain 
a discrete image. The minimum sampling rates are given by the Nyquist rates 
and are computed from the maximum frequencies in the two directions. 


17.5.3 Image formats 

Like digital audio, images are available in a wide variety of formats, including 
pgm, ppm, gif, jpg, and tiff. In each format, a digital image is stored as a ID 
stream of numbers. The difference in the format lies in the manner in which the 
image data is compressed before storage. The portable graymap (PGM) format 
is used for storage of gray-level images, where raw data is stored without 
compression in the ASCII or binary representations. A few bytes of header 
information included before the image data describe the format of the file, the 
representation (ASCII or binary) used and the number of rows and columns 
in the image. The portable pixmap (PPM) format is an extension of the PGM 
format for color images, where the intensities of the three primary colors are 
stored for each pixel. 

The graphical interface (GIF) format uses a compression algorithm to reduce 
the size of the data file. It is limited to 8-bit (256) color images and hence is 
suitable for images with a few distinctive colors. It supports interlacing and 
simple animation, and it can also support grayscale images using a gray palette. 

The joint photograph expert group (JPEG) format uses transform-based com- 
pression and provides the user with the capability of setting the desired com- 
pression ratio. 

The tagged image file (TIFF) format supports different types of images, 
including monochrome, grayscale, 8-bit and 24-bit RGB images that are tagged. 
The images can be stored with or without compression. 
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Matlab provides two library functions imread and imwrite, respec- 
tively, to read and write images. These functions can read and write the image 
files in several different formats. The following code shows the syntax for call- 
ing these functions: 


» x = imread (' rini . jpg ' 
» size (x) ; 

» imshow(x) ; 

» xd = double (x); 


) ; % x is a 2-D "uint" type array 
% displays the size of the image 
% displays the image 
% xd is the image array 
% with double precision 


» xmax = max(max(xd) ) 

» x_bright=uint8 (xd*2 ) ; % increases brightness of image 

» imwrite (x_bright , 'rini_bright . jpg', 'jpg', 

' Quality' , 80 ) ; 


The above code loads the Rini test image from the rini . j pg file and displays 
the image in Fig. 17.17(a) using the imshow function. The imread function 
used in the code returns an array stored as unsigned integers with 8-bit precision. 
To carry out any arithmetic operation on the image, we need to convert the data to 
other data types. The instruction double changes the data type from unsigned 
integer to double. The instruction max determines the maximum gray level 
present in the image, and for the Rini image the value of xmax is given by 124. 
As xmax has a low value, the image has low brightness, as observed in Fig. 
17.17(a). A possible way to improve the brightness of the image is to increase 
the intensity level of the whole image linearly. In an 8-bit image, the maximum 
gray level is 255. Therefore, we scale up the gray values by a factor of 2, which 
is achieved by multiplying the intensity by a factor of 2. This is followed by 
the conversion of the gray values to the uint8 type. The brightened image 
represented by the matrix x_bright is shown in Fig. 17.17(b). The last line 
of the Matlab code stores the brightened image in the JPEG format with 
filename rini_bright.jpg using the imwrite function. Note that the 
JPEG format compresses the gray image based on the specified quality factor, 
which is a number between 0 and 1 00. A high value for the quality factor implies 
higher quality with low compression, while a low value of the quality factor 
implies lower quality with high compression. Using a quality factor of 80, the 
processed rini image is compressed to a file size of 27 kbytes. Compared with 
the original rini . jpg file, which has a size of 180 kbytes, this implies a 
compression ratio of 6.66. 


17.5.4 Spectral analysis of images 

Like real audio signals, natural images are non-stationary signals. The fre- 
quency content of the images is estimated by extending the ID spectral analysis 
techniques, presented in Section 17.1, to two dimensions. Here, we discuss the 
average periodogram approach to calculate the power spectrum of a 2D image. 
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Fig. 17.17. Rini test image loaded 
from the rini . jpg file. 

(a) Original and (b) brightened 
versions. 



(a) 


(b) 


Step 1 Parse the input image into smaller 2D segments by applying a 2D 
window g[m ,n\. Depending upon the application, the parsed segments may or 
may not have overlapping pixels. 

Step 2 Compute the 2D DFT /(■!?,„, f2 n ) of each image segment i(m, n), which 
is used to estimate the power spectrum based on the following expression: 

P/(f2)= \\I(C2 m , {2 n )\ 2 , (17.21) 

where // is the norm of the 2D window function defined as follows: 


Step 3 The average power spectrum is obtained by averaging the waveforms 
obtained in step 2. 

We illustrate the steps involved in computing the power spectrum with the 
following example. 

Example 17.8 

Consider the synthetic image, referred to as the sinusoidal grating, defined by 
the following equation: 



(17.22) 


i(x, y ) = 127 cos[27r(4x + 2y)]. 


(17.23) 
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Discretizing the analog image with a sampling rate of 20 samples/spatial unit 
in each direction, the DT image is given by 

i[m, n] = 127cos[2tt(4 m + 2n)/20] (17.24) 

for 0 < m, n < 255. Compute the power spectrum of the DT image using the 
average periodogram approach. 


Solution 

We plot the DT image modeled in Eq. (17.24) using the following Matlab 
code: 


» nr = [0:1:255] ; 

» n = [0:1:255] ; 

» [mgrid, ngrid] = 
meshgrid (m, n) ; 

» I = 127*cos (2*pi* (4*mgrid 

» imagesc(I); 

» axis image ; 

» colormap (gray) ; 


% x-coordinates 
% y-coordinates 

% determine the 2D meshgrid 
+ 2 *ngrid) / 2 0 ) ; 

% pixel intensities 
% sketch image 


The resulting image is shown in Fig. 17. 1 8(a). The power spectrum is calculated 
using the 2D Bartlett window of size (64 x 64) pixels, an overlap of (48 x 48) 
pixels between adjacent windows, and a (256 x 256)-point DFT for each parsed 
subimage. The Matlab code used to compute the power spectrum is given 
by 


» m = [0:1:255] ; 

» n = [0:1:255] ; 

» [mgrid, ngrid] 

= meshgrid (m, n) ; 

>> I = 127*cos (2*pi* 

% 2D Bartlett window 
>> x = bartlett (64) ; 

>> for i = 1:64 

zx ( i , : ) = x ' ; 

zy ( : , i ) = x ; 

>> end 

>> bartlett2D = zx . * zy; 


% x-coordinates 
% y-coordinates 
% determine the 
% 2D meshgrid 
(4*mgrid + 2 *ngrid) /20 ) ; 

% pixel intensities 


>> mesh (bartlett2D) 


displaying 2D 
% Bartlett window 
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Fig. 17.18. (a) Synthetic 
sinusoidal grating, (b) Power 
spectrum of the synthetic 
sinusoidal grating. 



% calculate power spectrum 
>> P = zeros (256, 256) ; 

» for (i = 1:64:255) 

for (j = 1:64:255) 

Isub = I (i : i+63 , j : j+63 ) . *bartlett2D; 

P = P + fft2 (Isub, 256, 256) ; 

end 

end 

% mesh plot with x and y-axis scaled by pi 
» mesh( [1:128] *2/256, [ 1 : 128 ] *2 /256 , 

abs(P(l:128, 1:128) /max(max(P) ) ) . ~2) ; 

Figure 17.18(b) illustrates a sharp peak at the horizontal frequency Q x = QAi r 
and at the vertical frequency fi y = 0.2 jt . This observation is consistent with 
the mathematical model, Eq. (17.23), used to construct the synthetic image. 
Unlike the earlier power spectrum plots, we use a linear scale along the "-axis 
in Fig. 17.18(b). 

The above Matlab code is modified to construct the power spectrum of a 
real test image, referred to as the Lena image. The test image has dimensions 
of 512 x 512 pixels and is illustrated in Fig. 17.19(a) along with its power 
spectrum in Fig. 17.19(b). In computing the power spectrum, a 2D Bartlett 
window of dimension 128 x 128 with an overlap of 96 x 96 pixels, and a (256 x 
256)-point DFT is used. The dB scale is used along the z-axis to plot the 
power spectrum. Real images typically include most frequencies and hence the 
power spectrum in Fig. 17.19(b) exhibits an almost uniform distribution over 
all frequencies in the horizontal and vertical directions. 
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Fig. 17.19. (a) Original 
(512 x 512) pixel Lena image, 
(b) Power spectrum of the Lena 
image. 


(a) 


(b) 




17.6 Image filtering 


Real images consist of a combination of smooth regions and active regions 
with edges. In smooth regions, the intensity values of the pixels do not change 
significantly. Therefore, the smooth regions represent lower-frequency com- 
ponents in the 2D frequency space. On the other hand, the intensity values in 
the active regions change significantly over edges. The active regions represent 
higher-frequency components. Extracting the low- and high-frequency compo- 
nents from a real image has important applications in image processing. In this 
section, we introduce frequency-selective filtering in two dimensions. 

The mathematical model for filtering a 2D image g[m, n] by a filter with an 
impulse response h[m, n] is given by 


oo oo 

y[m, n] = g[m, ri] * h[m, n] = g[m — q , n — r]h[q , r], (17.25) 

q——oo r=—oo 

where y[m, n] is the output response of the filter and * denotes the convolution 
operation. Alternatively, the filtering can be performed in the frequency domain 
using the following equation: 

Y(Q X , fly) = G(fl x , fl y )H{fl x , fly), (17.26) 

where G(fl x , fl y ) is the Fourier transform of the input image, H(fl x , fl y ) is the 
2D transfer function of the filter, and Y ( fl x , fl y ) is the Fourier transform of the 
resulting output. Like ID filters, 2D filters can be broadly classified into four 
categories: lowpass, bandpass, highpass, and bandstop filters. Some examples 
of these filters are given in the following. 
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Fig. 17.20. (a) Ayantika image 
corrupted with high-frequency 
noise. The noise appears as 
vertical and horizontal lines in 
the image, (b) Power spectrum 
of the Ayantika image. 



17.6.1 Lowpass filtering 

Lowpass filtering is widely used in many image processing applications. Some 
applications include reducing high-frequency noise that is corrupting an image, 
band-limiting the frequency component of an image prior to decimation, and 
smoothing the rough edges of an image. In Example 17.9 we provide an example 
of lowpass filtering in the spatial domain. 


Example 17.9 

Figure 17.20(a) shows a noise-corrupted image, referred to as Ayantika. Show 
that: 


(a) the image has high-frequency noise by plotting the power spectrum; 

(b) the lowpass filter with the following impulse response: 


h[m, n] 


1 

64 


2 

3 

4 
3 
2 


3 

4 

5 
4 
3 


2 

3 

4 
3 
2 


1 

2 

3 

2 

1 


(17.27) 


eliminates the high-frequency noise from the image. 


Solution 

The Matlab code used to plot the power spectrum is given by 

>> I = imread (' ayantika . tif ') ; 

>> I = double (I); 

>> I = I - mean (mean ( I ) ) ,- 
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% 2D Bartlett window 
>> x = bartlett (32 ) ; 

>> for i = 1:32 

z x ( i , : ) = x ' ; 
zy ( : , i ) = x; 

» end 

» bartlett2D = zx . * zy; 

» n = 0 ; 

% calculate power spectrum 
» P = zeros (256 , 256 ) ; 

» for (i = 1:16:320) 

for (j = 1:16:288) 

Isub = I ( i : i+3 1 , j : j +31 ) . *bartlett2D ,- 
P = P + fftshift (fft2 (Isub, 256, 256) ) ; 
n = n + 1 ; 

end 

» end 

» Pabs = (abs (P) /n) . ~2 ,- 

» mesh ( [-128 : 127] *2/256, [-128:127] *2/256, Pabs/ 
max (max ( Pabs ) ) ) ; 


The resulting power spectrum is shown in Fig. 17.20(b), where we see peaks at 
frequencies [f2 x , J2 V ] given by [0, 0], [0, ±0.57r], and [±0.57r, 0]. The peak at 
[0, 0] corresponds to the dc gain, whereas the remaining peaks are because of 
the additive noise that has corrupted the image. We now attempt to eliminate 
the noise with a lowpass filter. 

Figure 17.21(a) shows the magnitude spectrum of the filter with the impulse 
response specified in Eq. (17.27). We use the following Matlab code to plot 
the magnitude spectrum: 

» h = 1/64* [1 2 3 2 1; 2 3 4 3 2; 3 4 5 4 3; 2 3 4 3 2; 1 
2 3 2 1] ; 

» H = fftshift (fft2 (h, 256, 256) ) ; 

% magnitude spectrum with256-pt fft 

% 2D mesh plot with frequency axis normalized to pi 
» mesh( [-128 : 127] *2*1/256, [ -12 8 : 12 7 ] *2 *1/256 , abs (H) ) ; 

Since the filter provides a higher gain at the lower frequencies and lower gain 
at higher frequencies, it is clear that Fig. 17.21(a) corresponds to a lowpass 
filter. Note that the gain at frequencies [0, ±0.57 t] and [±0.57r, 0] is zero, 
therefore the lowpass filter would eliminate the additive noise. The filter 2 
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function is used to compute the output of the lowpass filter using the following 
code: 

» Y = f ilter2 (h, I) ; 

>> imagesc(Y); 

>> axis image; colormap (gray) ; 

The resulting output is plotted in Fig. 17.21(b). It is observed that the horizontal 
and vertical strips have been suppressed by the lowpass filter. However, the low- 
pass filter also suppresses some high-frequency components other than noise. 
Therefore, the quality of the filtered image degrades marginally, as observed 
at the edges. The image in Fig. 17.20(a) has crisp edges, whereas the edges in 
Fig. 17.21(b) are somewhat blurred. 


17.6.2 Highpass filtering 

Highpass filtering is used to detect the edges or suppress the low-frequency 
noise in an image. At times, highpass filters are also used to sharpen the edges 
of an image. Example 17.10 illustrates one application of highpass filtering. 


Example 17.10 

Consider the pepper image shown in Fig. 17.22(a). Show that the filter with the 
impulse response 


h[m , n] 



-1 -1 

8 -1 

-1 -1 


(17.28) 


extracts the edges of the image. 
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Fig. 17.22. (a) Original 512 x 
512 pixels peppers image. 

(b) Magnitude response of the 
highpass filter with impulse 
response shown in Eq. (17.28). 

(c) Output of the highpass filter. 




(c) 

Solution 

The following Matlab code is used to plot the magnitude spectrum: 

» h = 1/9* [-1 -1 -1; -1 8 -1; -1 -1 -1] ; 

% magnitude spectrum with 256-point fft 
» H = fftshift (fft2 (h, 256, 256) ) ; 

% 2D mesh plot with frequency axis normalized to pi 
» mesh( [-128 : 127] *2*1/256, [-128:1271*2*1/256, abs(H)); 

The magnitude frequency response of the filter is shown in Fig. 17.22(b). Since 
the gain of the filter is almost zero at low frequencies and unity at higher 
frequencies, Eq. (17.28) models a highpass filter. The output of the highpass 
filter is obtained using the following code: 

» I = imread ( 'peppers . tif ') ; 

» Y = f ilter2 (h, I) ; 

» imagesc(Y); 

>> axis image 

Figure 17.22(c) shows the output of the highpass filter. From the image plot, it is 
clear that the highpass filter extracts the edges, eliminating the smooth regions 
(low-frequency components) of the image. 
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17.7 Image compression 


Raw data from digital images requires large disk space for storage. Image 
compression reduces the amount of data needed to represent an image. As in 
audio compression, image compression techniques are grouped into lossless and 
lossy categories. With lossless compression, exact reconstruction of the original 
image is possible. However, the amount of compression that can be achieved 
with lossless compression is limited. Lossy compression introduces controlled 
distortion to increase the compression ratio. The redundancies exploited during 
image compression are classified into the following categories. 

Statistical redundancy The values of pixels in natural images have a non- 
uniform probability distribution of occurrences such that some values occur 
more frequently than others. Some compression can be achieved by allocat- 
ing fewer bits to represent pixels that occur more frequently and more bits to 
represent pixels that occur less frequently. 

Spatial redundancy In real images, the value of a pixel is highly correlated to 
its neighboring pixels. Image compression exploits such spatial redundancy to 
compress the image. 

Psychovisual redundancy The human visual system (HVS) is less sensitive 
to certain features within an image. For example, slight variations in the pixel 
intensities within a uniform region cannot be perceived by the HVS. Image 
compression exploits such psychovisual redundancy to remove features from 
the image whose presence or absence is inconceivable to the HVS. 


17.7.1 Predictive coding 

Predictive coding exploits spatial redundancy to compress an image. Instead of 
encoding the original pixels, predictive-coding schemes calculate the difference 
between the actual pixel values and the estimated pixel values predicted from the 
neighboring pixels. The resulting difference or error image is instead encoded. 
Since the difference image has lower correlation than the original image, more 
compression is achieved by encoding the difference image. Predictive coding 
may use a universal model or a localized model derived from the reference 
image. Examples of universal predictive models are listed below: 

first-order prediction i[m, n] = i[m, n — 1]; (17.29) 

i[m, «] = i [m — 1, n]; (17.30) 

second-order prediction i[m, n] = 0.48/ [m, n — 1] + 0.48/ [m — 1, n] 

(17.31) 

i[m, n] — 0.33/ [m, n — 1] + 0.33 / [m — 1, n] 

+ 0.33/[m - \,n - 1]. (17.32) 


third-order prediction 
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Predictive compression techniques can be considered as an extension of DPCM 
in two dimensions. Example 17.11 illustrates the use of the third-order predictive 
model in compressing still images. 


Example 17.11 

Consider the Sanjukta image shown in Fig. 17.23(a). The first 4x4 pixels of 
the image are given by 


"156 

157 

154 

149" 

156 

159 

159 

155 

153 

158 

160 

159 

149 

154 

157 

156 


(17.33) 


Using the predictors in Eqs. (17.30) and (17.31) for the first row and column, 
respectively, and the predictor in Eq. (17.32) to predict the remaining values, 
calculate the error in the reconstructed image. In your calculations, assume that 
the quantizer divides the difference image by a quantization factor Q = 3 and 
rounds to the nearest integer before quantization. 


Solution 

Using zero boundary conditions, the predicted sample value, the prediction 
error, the quantized error, and the reconstructed sample value at m = 0, n = 0 
are given by 

predicted value i[0, 0] = 0; 

error e[0, 0] = i [0, 0] - s[0, 0] = 156; 

quantized error e[0, 0] = round(156/3) = 52. 

reconstructed value i'[0, 0] = z[0, 0] + 3 x e[0, 0] = 0 + 3 x 52 = 156. 

For spatial location m = 0, n = 1, the predicted sample value, the prediction 
error, the quantized error, and the reconstructed sample value are given by 

predicted value z[ 0, 1] = i'[0, 0] = 156; 

error e[0, 1] = z[0, 1] - i[0, 1] = 157 - 156 = 1; 

quantized error e[0, 1] = round(l/3) = 0; 

reconstructed value i'[0, 1] = z[0, 1] + 3 x e[0, 1] = 156. 

For spatial location m = 0, n = 2, the predicted sample, the prediction error, 
the quantized error, and the reconstructed sample value are given by 

predicted value z[0, 2] = i'[0, 1] = 156; 

error e[0, 2] = i[0, 2] - i[0, 2] = 154 - 156 = -2; 

quantized error e[0, 2] = round(— 2/3) = — 1; 

reconstructed value z'[0, 2] = z[0, 2] + 3 x e[0, 2] = 156 — 3 = 153. 
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For spatial location m = 0, n = 3, the predicted sample value, the prediction 
error, the quantized error, and the reconstructed sample value are given by 

predicted value z[0, 3] = z'[0, 2] = 153; 

error e[0, 3] = z[0, 3] - I[ 0, 3] = 149 - 153 = -4; 

quantized error £[0, 3] = round(— 4/3) = — 1; 

reconstructed value z'[0, 3] = z[0, 3] + 3 x e[0, 3] = 153 — 3 = 150. 

For spatial location m = 1, n = 0, the predicted sample value, the prediction 
error, the quantized error, and the reconstructed sample value are given by 

predicted value z[l, 0] = i'[ 0, 0] = 156; 

error e[l, 0] = i[ 1, 0] - z[l, 0] = 156 - 156 = 0; 

quantized error e[l, 0] = round(0/3) = 0; 

reconstructed value z'[ 1, 0] = z[l, 0] + 3 x e[l, 0] = 156 + 0 = 156. 

For spatial location m = 1, n = 1, the predicted sample value, the prediction 
error, the quantized error, and the reconstructed sample value are given by 

predicted value ?[1, 1] = 0.33(/'[l, 0] + z'[0, 1] + i'[ 0, 0]) 

= 0.33 x 468 = 154.44; 

error e[l, 1] = z[l, 1] - z[l, 1] = 159 - 154.44 = 4.56; 

quantized error e[l, 1] = round(4.56/3) = 2; 

reconstructed value z'[l, 1] = z[l, 1] + 3 x e[l, 1] = 154.44 + 6 = 160.44. 

For spatial location m = l,n = 2, the predicted sample value, the prediction 
error, the quantized error, and the reconstructed sample value are given by 

predicted value z[l, 2] = 0.33(z'[l, 1] + z'[0, 2] + z'[0, 1]) 

= 0.33 x 469.44 = 154.92; 

error e[l, 2] = z[l, 2] - z[l, 2] = 159 - 154.92 = 4.08; 

quantized error e[l, 2] = round(4.08/3) = 1; 

reconstructed value z'[l, 2] = i[l, 2] + 3 x e[l, 2] = 154.92 + 3 = 157.92. 

For spatial location m = 1, n . = 3, the predicted sample value, the prediction 
error, the quantized error, and the reconstructed sample value are given by 

predicted value z[l, 3] = 0.33(z'[l, 2] + z'[0, 3] + z'[0, 2]) 

= 0.33 x 460.92 = 152.10; 

error e[l, 3] = z[l, 3] - z[ 1, 3] = 155 - 152.10 = 2.90; 

quantized error e[l, 3] = round(2.90/3) = 1; 

reconstructed value z'[l, 3] = z[l,3] + 3 x e[l,3] = 152.10 + 3 = 155.10. 
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Similarly, the pixel values at other locations can be calculated using the above 
procedure. The computed values are as follows: 


"156 

156 

153 

150 

156 

160.4 

157.9 

155.1 

153 

157.9 

160.2 

159.2 

O 

IT! 

155.1 

156.2 

156.9 


Subtracting the aforementioned values from the original values given in Eq. 
(17.33) gives the following values for the error image: 



' 0 

1 

1 

-1 

e[m, n] = 

0 

-1.4 

1.1 

-0.1 

0 

0.1 

-0.2 

-0.2 


_-l 

-1.1 

0.8 

-0.9 


In image compression, the mean square error (MSE) is typically used to measure 
the quantitative quality of a compressed image i'[m, n]. The MSE is defined as 
follows 

1 M — \ N—\ 

MSE = [ i[m , n] — i'[m, n]], 

m= 0 m = 0 

where i\m,n] is the pixel intensity of the original image having (M x N) 
dimensions. For Example 17.1 1, the MSE is given by 0.6206. 

In DPCM, the first pixel is referred to as the reference pixel and is typically 
encoded directly with e|0, 0] = 0. The remaining pixels are encoded using 
the error image, which is typically divided by a quantization factor Q before 
encoding. To achieve quantization, the entire dynamic range of the error image 
is divided into 2 B intervals and each interval is represented by B bits. Typi- 
cally, B is kept small to achieve a large compression ratio. Figure 17.23 shows 
two reconstructed Sanjukta test images processed at two different compres- 
sion ratios. Figure 17.23(b) is compressed with a quantization factor Q = 5 
and B = 4. Similarly, Fig. 17.23(c) is compressed with a quantization factor 
Q = 16 and B — 2. Higher compression introduces more distortion in Fig. 
17.23(c), which is illustrated by the lower subjective quality of Fig. 17.23(c) 
when compared with that of Fig. 17.23(b). The superior quality of Fig. 17.23(b) 
can also be quantified by computing the MSE. Figure 17.23(b) has a reconstruc- 
tion MSE of 6, while Fig. 17.23(c) has a MSE of 44. If required, the quantized 
error values can be further encoded using a variable-length code or an entropy 
code to achieve more compression. 


17.7.2 Image compression standards 

DPCM provides moderate compression. Several techniques, such as transform 
coding, arithmetic coding, and object-based techniques, have been developed 
to achieve performances superior to DPCM. In addition, several image com- 
pression standards have been developed by the International Organization for 
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(e) 

Fig. 17.23. Subjective quality of two DPCM encoded images, (a) Sanjukta image, (b) Reconstructed image 
after DPCM compression with a quantization factor Q of 5 and a 4-bit quantizer, (c) Same as (b) except the 
quality factor Q is set to 16 and a 2-bit quantizer is used, (d) Difference between the original image and 
reconstructed image shown in (b). (e) Difference between the original image and the reconstructed image 
shown in (c). The MSE associated with image (b) is 6, while the MSE associated with image (c) is 44. 
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Standardization (ISO) and the International Telecommunication Union (ITU) 
to ensure compatibility between different compressed bit streams. A popular 
ISO image compression standard is referred to as the JPEG standard, selected 
as an acronym for the Joint Photographic Experts Group, the ISO subcommittee 
responsible for developing the standard. 

The JPEG standard algorithm encodes both gray level and color images. 
In this standard, an image is decorrelated using the discrete cosine transform 
(DCT). The DCT coefficients are quantized and the quantized coefficients are 
encoded using a combination of run length and Huffman coding. The size of 
the compressed bit stream is varied by changing the quality factor Q, which 
has a value between 1 and 100. The highest quality representation is obtained 
using a quality factor of 100, and the lowest quality representation is obtained 
using quality factor of 1 . A high quality factor ensures superior perceived qual- 
ity, but the compression is limited. Conversely, a low quality factor increases 
compression, but at the expense of quality. 

The image processing toolbox in M ATLAB includes a simplified version of 
the JPEG encoder and decoder, which allows images to be encoded at different 
quality factors Q. If x is a 2D array containing the gray values of a test image, 
the following command: 

» imwrite (x, ' test_70 . jpg' jpg' , 'Quality ' , 70); 

creates the JPEG compressed image “test_70.jpg” with a quality factor of 70. 
The following example illustrates the compression performance of the JPEG 
encoder and decoder. 

Example 17.12 

Consider the 8-bit Sanjukta image shown in Fig. 17.23(a). Using the imwrite 
command, generate different compressed JPEG images with quality factors 
100, 50, 25, 10, and 5. Determine the compression ratio in each case and plot 
the reconstructed images. 

Solution 

The following MATLAB code creates compressed images with different quality 
factors: 

>> x = imread ( ' sanjukta_gray . tif ' ) ; 

>> imwrite (x, ' sanjukta_100 . jpg' jpg' Quality ' , 100) ; 

>> imwrite (x, 'sanjukta_50 . jpg' jpg' , 'Quality' , 50) ; 

>> imwrite (x, 'sanjukta_25 . jpg' ,' jpg' , 'Quality' , 25) ; 

>> imwrite (x, 'sanjukta_10 . jpg' ,' jpg' , 'Quality' , 10) ; 

>> imwrite (x, 'sanjukta_5 . jpg' ,' jpg ',' Quality ' , 5) ; 

The raw image has 126 672 pixels, with each pixel represented using 8 bits. 
Therefore, the uncompressed image size is 126 672 bytes or 126.7 kbytes. The 
sizes of the compressed files determined from the compressed files and their 
respective compression ratio are provided in Table 17.2. Table 17.2 illustrates 



(e) (f) 

Fig. 17.24. Subjective quality of JPEG compressed images using different quality factors, (a) Original 
image; (b) quality factor 100; (c) quality factor 50; (d) quality factor 25; (e) quality factor 10; (f) quality 
factor 5. 
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Table 17.2. Comparison of JPEG compression performance for sanjukta.gray image 


Quality factor, Q 

Name of the compressed file 

Size of the file (kbytes) 

Compression ratio 

MSE 

100 

sanjukta_100 

41.7 

3 

0.05 

50 

sanjukta_50 

11.1 

11 

12.34 

25 

sanjukta_25 

4.8 

26 

18.98 

10 

sanjukta_10 

2.9 

43 

36.69 

5 

sanjukta_5 

2.3 

54 

76.05 


that decreasing the quality factor increases the compression ratio at the cost of 
the reconstruction quality, apparent from the increase in MSE. 

To provide a subjective comparison, the reconstructed images are shown in 
Fig. 17.24. We observe that the perceived quality of the reconstructed images 
degrades with the decrease in the quality factor. In other words, there is a 
trade-off between quality and size of the compressed file. 


17.8 Summary 


This chapter presented applications of digital signal processing in audio and 
image processing. Digital signals, including audio, images, and video, are ran- 
dom in nature. Section 17.2 presented an overview of spectral analysis methods 
for random signals based on the short-time Fourier transform, spectrogram, and 
periodogram. Section 17.3 covered fundamentals of audio signals, their storage 
format, and spectral analysis of audio signals. Filtering of audio signals was 
covered in Section 17.3, and principles of audio compression were presented 
in Section 17.4. 

Section 17.5 extended digital signal processing to 2D signals. In particular, 
we introduced digital images, their storage format, and the spectral analysis 
of image signals. Section 17.6 covers 2D filtering, including the application 
of lowpass filters to eliminate high-frequency noise and highpass filters for 
edge detection. In each case, we presented examples of image filtering through 
Matlab . Section 17.7 introduced principles of image compression including 
the 2D differential pulse-code modulation (DPCM) and the Joint Photographic 
Expert Group (JPEG) standard. Using Matlab, we compared the perfor- 
mance of JPEG at different compression ratios. 


Problems 


17.1 Consider the following deterministic signal: 

x\ [&] = 2 sin(0.2jr&) + 3 cos(0.57tA:). 

Using a DFT magnitude spectrum, estimate the spectral content of 
x\k] for the following cases: (a) a 20-point DFT and a sample size 
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of 0 < k < 19; (b) a 32-point DFT and a sample size of 0 < k < 31; (c) 
a 64-point DFT and a sample size of 0 < k < 31; (d) a 128-point DFT 
and a sample size of 0 < k < 31; and (e) a 128-point DFT and a sample 
size of 0 < k < 63. Comment on the leakage effect in each case. 

17.2 Calculate and plot the amplitude spectra of the following DT signals: 

(i) x\ [A:] = cos( 0.257 tA:), 0 < k < 2000; 

(ii) x 2 [k\ = cos(2.5 x 10~ 4 jtk 2 , 0 <k< 2000; 

(iii) x 3 [k ] = cos(2.5 x 10“ 7 ttA: 3 ), 0 < k < 11000. 

Comment on the spectral content of the signals. 

17.3 Calculate and plot the spectrograms of the three signals considered in 
Problem 17.2. Compare the results with those obtained in Problem 17.2. 

17.4 Using Matlab, estimate the power spectral density of the following 
signal: 

x[Ar] = 2cos(0.4:rA: + &i) + 4cos(0.8:rA: + 0 2 ), 

where 9\ and (h are independent random variables with uniform distri- 
bution between [0, it]. Use a sample realization of x[k] with 10 000 
samples, the Bartlett window with length 1024, an overlap of 600 sam- 
ples, and the average Welch approach. 

17.5 Determine the frequency content of the audio signal “chord.wav”, 
provided in the accompanying CD using (i) a spectrogram and (ii) an 
average periodogram. 

17.6 Consider the “testaudio4 . wav” file provided in the accompanying 
CD. Load the audio signal using the wavread function available in 
Matlab. 

(a) What is the sampling rate used to discretize the signal? What is the 
total number of samples stored in the file? 

(b) How many bits are used to represent each sample? 

(c) Is the audio signal stored in the mono or stereo format? 

(d) Estimate the power spectrum of the signal 

17.7 Repeat Problem 17.6 for “testaudio3 . wav” provided in the accom- 
panying CD. 

17.8 Repeat Problem 17.6 for “bell .wav” provided in the accompanying 
CD. 

17.9 Repeat Problem 17.6 for “test44k.wav” provided in the accompa- 
nying CD. 

17.10 Repeat Example 17.7 for the following audio samples: 


Xl [k] = [66, 67, 68, 69] and x 2 [k] = [66, 72, 61, 56], 
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Show that the reconstruction error is greater for the second case, where 
the neighboring audio samples are less correlated. 

17.11 Consider the “girl . j pg” file provided in the accompanying CD. Read 
the image using the imread function available in Matlab. 

(a) What are the dimensions of the image stored in the “girl . jpg” 
file? 

(b) What are the maximum and minimum values of the intensity of the 
pixels stored in the file? 

(c) Sketch the image using the imagesc function available in 
Matlab. 

(d) Calculate and plot the 2D power spectrum of the image to illustrate 
the dominant spatial frequency components of the image. 

17.12 Consider the 2D filter defined by the following impulse response: 

1111 " 

1111 
1111 ' 

1111 


h\m, nl = — 
16 


(a) Show that h[m, n] is a lowpass filter by sketching its magnitude 
spectrum using the mesh plot. 

(b) Assume that the image stored in “girl . jpg” is applied at the 
input of the filter h [m , n]. Determine and sketch the output image. 

(c) Calculate the 2D power spectrum of the filtered image. Comparing 
this with the result of Problem 17.1 1 (d), highlight how the high- 
frequency components have been attenuated in the filtered image. 


17.13 Repeat Problem 17.12 for the 2D filter with the following impulse 
response: 


h[m, n] 


0 0 0.0221 

0 0.1563 0.3907 

0.0221 0.3907 1 

0 0.1563 0.3907 

0 0 0.0221 


0 0 

0.1563 0 

0.3907 0.0221 
0.1563 0 

0 0 


17.14 Consider the 2D filter defined by the following impulse response: 


h[m , n ] 



-1 -1 

8 -1 

-1 -1 


(a) Show that h[m, n] is a highpass filter by sketching its magnitude 
spectrum using the mesh plot. 

(b) Assume that the image stored in “girl . jpg” is applied at the 
input of the filter h[m, n], Determine and sketch the output image. 
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Show that the highpass filtering leads to the detection of edges in 
the image. 

(c) Calculate the 2D power spectrum of the filtered image. Comparing 
this with the result of Problem 17.1 1 (d), highlight how the low- 
frequency components have been attenuated in the filtered image. 


17.15 Repeat Problem 17.14 for the 2D filter with the following impulse 
response: 


h[m, n\ 


1 

(h2l 


0 0 -0.0442 0 0 

0 -0.3126 -0.7815 -0.3126 0 

-0.0442 -0.7815 4.5532 -0.7815 -0.0442 . 

0 -0.3126 -0.7815 -0.3126 0 

0 0 -0.0442 0 0 


17.16 Repeat Example 17.1 1 for the following selections of (4 x 4) pixels: 


ii[m, n] = 


him, n ] = 


"156 

157 

158 

159" 

150 

151 

151 

150 

153 

155 

154 

156 

_ 155 

154 

157 

156 _ 

"156 

177 

148 

189" 

160 

171 

181 

150 

123 

125 

174 

196 

.175 

164 

147 

156 _ 


and 


Show that the reconstruction error is greater for the second case, where 
the neighboring pixels are less correlated. 


17.17 Compress the image stored in the file “1 ena . t i f ” in the accompanying 
CD using the JPEG standard with quality factors set to 80, 60, 40, 20, 
and 10. Determine the compression ratio for different quality factors 
and show that the subjective quality deteriorates as the quality factor is 
decreased. Compute the mean square error for the compressed images. 


Appendix A Mathematical preliminaries 


A.1 Trigonometric identities 


e ±Jf = cos f ± j sin f 

cos t = — [eJ f + e” jf ] 

2 

sinf = — [e j ' — e~j r ] 

2j 

cos ^f ± — ^ sinf 

sin (t ± — ^ = ± cos f 
sin 2t = 2 sin f cos f 
cos * 2 t + sin 2 t = 1 

cos 2 t — sin 2 t = cos It 
, 1 

cos 2 t = -(1 + cos 2 1) 

, 1 

sin t = -(1 — cos 2 1) 

, 1 

cos t = - (3 cos t + cos 3f ) 

, 1 

sin t = -(3 sinf — sin3f) 

cos(f ± 9) = cos t cos 0 q= sin f sin 0 

sin(f ± 0) = sinf cosf? ± cosf sinf? 


tan (f ± 0) = 


tan f ± tan 0 
1 tan f tan 0 


1 

sinf sinf? = -[cos(f — 0) — cos (f + f?)] 

1 

cos f cos f? = - t cos ( f + 9) + cos(f — ^)] 
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1 

sin t cos 6 = - [sin(f + 9) + sin(f — 0)] 

a cos t + b sinf = C cos (t + 9),C = \/ a 1 + b 2 , 6 = tan _1 (— b/a) 

Jj 

a cos (mt) + b sin (mt) = \J a 1 + b 2 cos (mt — 9), 9 = tan^ 1 — 

a 

a cos (mt) + b sin (mt) = \J a 1 + b 2 sin (mt + <p), </> = tan~* — 

b 


A.2 Power series 


t 2 f 3 f 4 

ln(l +t) = t + 

2 3 4 

, t 2 f 3 f 4 

e f = 1 + f H 1 1 [ 

2! 3! 4! 

f 3 f 5 t 1 

sin t = t 1 h- 

3! 5! 7! 


lit 1 


cos f = 1 1 

2! 4! 6! 

f 3 2 1 5 

tan t = t H 1 , 

3 15 315 

It 3 * * 1.3 1 5 

t — t + “h ( 

2 3 2.4 5 


sin 


-i 


A.3 Series summation 


Arithmetic series 


N 


+ (« - IV] = — [2a + (AT - 1 )d] 


J^n=l + 2 + --- + N = 


N(N + 1) 


n = 1 


Geometric series 


^ „ a (l — r N+1 ) 

> ar = 

n 1 - r 

«=0 


exp 


2nkn 

] ^r 


£ 

n=0 

oo . 

i>-=^ 

n=0 
oo 

V nr" = |r| < 1 

H d-r ) 2 ’ 11 


0 l<£<(iV-l) 

IV k = 0, 


|r I < 1 


r 

r 
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The geometric progression (GP) series sum of the form 

N 

S = ar' 1 — a + ar + ar 2 + • • • + ar N 

n= 0 

is used frequently in this text while dealing with the discrete-time signals. Note 
that the factor r can be real, imaginary, or complex. 


A.4 Limits and differential calculus 


lim t 01 Inf = 0, Re(a) > 0 

t — > OO 

lim t a Inf = 0, Re(a) > 0 
o 


L'Hopital's Rule: 


x'(t) 

If lim x(t) = limy(r) = 0 or lim^(f) = limy(f) = oo, and lim has a 

t—>a t—>a t—>a t—>a t—>a y'(t ) 

finite value, then lim — 1 — = lim — — 

f^a y(t) t—m y'(f ) 

1 d g(t) 


d 

dr 

d 

dr 


g 2 (t) dr 


il- 

hit) 1 = 
g(0j g 2 (t) 


1 


g(t) 


d h(t) 
d t 


hit) 


d git)' 
d t 


A.5 Indefinite integrals 


f u dv = uv — f v du 
f f(t)g(t) dr = f(t) f g(t)dt 


■mi 


-77 / g(t)dt 


d t 


/ 

/ 

/ 

/ 

I 

I 


i 

cos at dr = — sin at + C, a 0 
a 

1 

sin ar dr = — cos at + C, a ^ 0 
a 


cos 2 at dr = 


r 

2 


sin 2 at dr = 


r 

2 


sin 2 at 
4 a 

sin 2 at 
4 a 


+ C, a ^4 0 
+ C , a ^ 0 


1 

r cos at d r = ^ (cosar + at sinar) + C, a ^ 0 
a- 


1 

r sin ar dr = — (sin at — ar cos at) + C, a ^ 0 
a- 
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f t 2 cos at dr = —(2 at cos at — 2 sin at + ci 2 1 2 sin at) + C , a ^ 0 

/ 1 2 sin or dr = —(2 at sin at — 2 cos at — a 2 t 2 cos at) + C, a ^ 0 

. sin(a — b)t sin(a + b)t , , 

f cos at cos bt dr = 1 \- C,a l ^ fo" 

J 2 (a - fo) 2(a + fo) 

, sin(a — b)t sin(rr + b)t , , 

/ sinar sin for dr = ^ J + C, a 2 ^ fo 2 


/ sinar cos for dr = 


2(a — fo) 2 (a + fo) 
cos(a — fo)r cos(a + fo)f 


2(a - fo) 2(a + fo) 

f sin^ 1 at dr = t sin -1 at H — \J 1 — a 2 r 2 + C,a ^ 0 

a 

J cos -1 at dr = r cos -1 ar V 1 — a 2 f 2 + C, a ^ 0 

/ e n 'dr = — e fl ' + C, a ^ 0 

b al 

f b a 'dt = + C, a # 0, fo > 0, fo # 1 

a Info 

e at 

f te a 'dt = — (at — 1) + C, a ^ 0 


+ C, a" ^ fo" 


f t 2 e a 'dt = —(crt 2 — 2ar + 2) + C, a ^ 0 


f r"e°'dr = -r"e af - - [ r"' 1 
a a J 

/ 


e n 'dr, a ^ 0 


f t n b a, dt = 


t"b a ’ n 
a In fo n In fo 


r n_1 fo a 'dr,a ^ 0, fo > 0,fo ^ 1 


J e fl ' sin for dr = 


+ fo 2 


(a sin for — fo cos for) + C 


e fl ' cos for dr = 


i 2 + b 2 

f n+i 


(i a cos for + fo sin for) + C 


fH + 1 


f r" lnar dr = lnar - 

J n+ 1 (n + l) 2 


+ C,« ^ -1 


1 


, dr = - tan + C, a ± 0 

r 2 +a 2 a \a J 

-r— ^ — -dr = ^ ln(r 2 +a 2 ) + C 

t 2 + a 2 2 


Appendix B Introduction to the 

complex-number system 


In this appendix, we introduce some elementary concepts that define complex 
numbers. In presenting the material, it is anticipated that most readers have 
some prior exposure to complex numbers, so the information presented here 
serves primarily as a review. The appendix is organized as follows. In Section 
B.l, we review the definition of real numbers and then survey their arithmetic 
properties, including some basic operations like addition, subtraction, multipli- 
cation, and division. Section B.2 extends the arithmetic operations to complex 
numbers, and Section B. 3 introduces its geometric structure using the 2D Carte- 
sian representation. Section B.4 presents an alternative representation, referred 
to as the polar representation for complex numbers. Section B.5 concludes the 
appendix. 


B.l Real-number system 


A real-number system 91 is a set of all real numbers, which is defined in terms of 
two basic operations: addition and multiplication. For two arbitrarily selected 
real numbers a, b e 91, these basic operations are given by 

addition s\ — a + b; (B.l) 

multiplication m i — a x b, (B.2) 

such that si, m \ e 91. The remaining arithmetic operations, for example, sub- 
traction and division, are expressed in terms of Eqs (B.l) and (B.2) as follows: 

subtraction S 2 = a — b = a + (—b)\ (B.3) 

division w 2 = a/b = a x (1 /b), (B.4) 

such that 52 , m 2 e 91. The real number — b is referred to as the additive inverse 
of b since h + (— b) = 0. Likewise, the real number I /b is referred to as the 
multiplicative inverse of b since b x (1 /b) — 1. For 91 to represent a complete 
set of real numbers, it must satisfy the following properties. 
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Fig. B.l. Representation of a 
real-number system using a ID 
straight line. 


- I I I I I I I I I I I I I I I I I 

-4 -3 -2 -1 0 1 2 3 4 


(i) The addition of two real numbers a , b e 91 produces a unique real number 
si e ill. 

(ii) Subtracting a real number a e 9i from another real number/? e 91 produces 
a unique real number S 2 € 91. 

(iii) Multiplication of two real numbers a,b e 91 produces a unique real number 
m\ e 91. 

(iv) Dividing a real number a e 91 by another real number b e 9i, b ^ 0, pro- 
duces a unique real number mi e 91. 

Frequently, a real-number system is modeled graphically using a ID straight 

line, as illustrated in Fig. B.l. Each point on the line represents a real number. 

The ID line is packed with real numbers such that an uncountable number of 

real numbers exists between two arbitrarily selected points on the line. 


B.2 Complex-number system 

Let j be the root of the equation x 2 + 1 = 0, such that j = *J—\. In terms of j, 
a complex number x is defined as 

x = a + )b, such that x e C, (B.5) 

where a and b represent two real numbers, a, b e 91, and C denote a set of 
all possible complex numbers. Equation (B.5) is referred to as the rectangular 
or Cartesian representation of the complex number x. From Eq. (B.5), it is 
straightforward to deduce the following: 

(i) The real component of the complex number x is a. This is denoted by 
91(x) = a. 

(ii) The imaginary component of the complex number x is b. This is denoted 
by Js(x) = b. 

In the following, we define the basic arithmetic operations between two complex 
numbers. In our definitions, we use the following two operands: xi = a\ + j/?i 
and x '2 = U 2 + j b 2 , with xi,X 2 e C and cq, ci 2 , b\,b 2 e 91. 


B.2.1 Addition 


Addition of two complex numbers is defined as follows: 


xi + X 2 = (a i +]b\) + (a 2 +.^ 2 ) 
— ( a i + a i) + j(^i + ^2). 


(B.6) 
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In other words, when adding two complex numbers the real and imaginary 
components are added separately. 


B.2.2 Subtraction 


The definition of subtraction follows the same lines as that for addition. Sub- 
tracting a complex number x 2 from x\ is defined as follows: 

*1 - -*2 = («i + )b\) - (a 2 + )b 2 ) 

= ( ai - a 2 ) + m - b 2 ). 

As for addition, the real and imaginary components are subtracted separately. 


B.2.3 Multiplication 

Multiplication of two complex numbers x\ and x 2 is defined as follows: 

xix 2 = (a i + )bi)(a 2 + ]b 2 ) 

= + ]b\a 2 + ]a\b 2 +fbib 2 

= (a\a 2 - b\b 2 ) + ](b\a 2 + a\b 2 ), (B.8) 

where the final expression is obtained by noting that j 2 = — 1 . 


B.2.4 Complex conjugation 

From Eq. (B.8), it is easy to deduce that 

(at + )b\\ai -]bi) = («i) 2 + {bif. (B.9) 

In other words, the imaginary component is eliminated. The complex number 
x* = a\ — ]b\ is referred to as the complex conjugate of xi = ci\ +jf>i, and 
vice versa. Equation (B.9) leads to the definition of the modulus or magnitude 
of a complex number, which is discussed next. 


B.2.5 Modulus 


The modulus (or magnitude) of a complex number x\ = a\ + )b\ is defined as 
follows: 

l*i I = = V(ai) 2 + (6i) 2 . (B.10) 


B.2.6 Division 


Dividing two complex numbers is more complicated. To divide x\ by x 2 , we 
multiply both the numerator and denominator by the complex conjugate of x 2 
and expand the numerator and denominator separately using the definition of 
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multiplication from Section B.2.3; i.e. 


M _ a 1 + j^i _ (a 1 + j^i) (a 2 ~ )b 2 ) 
x 2 a 2 + )b 2 (a 2 + j b 2 ) (a 2 - j b 2 ) 

aia 2 + b l b 2 ,a 2 b\ — a\b 2 


+ j 


(B. 11) 




where the final expression is obtained by noting that j 2 = — 1 . We illustrate 
these concepts with an example. 

Example B.l 

Two complex numbers are given by x — 5 + j7 and y = 2 — j4. Calculate 

(i) 9t(x), Js(x), Ot(y), 3(y); (ii) x + y; (iii) x — y; (iv) xy; (v) x*, y*; (vi) |x|, 
I v I ; and (vii) x/y. 

Solution 

(1) The real and imaginary components of the complex number x are S)l(x) = 
5 and 3(x) = 7. Likewise, the real and imaginary components of y are 
91(y) = 2 and ;3(y) = —4. 

(2) Adding x and y yields 


Since addition is commutative, the order of the operands does not matter, 
i.e. x + y = y + x. 

(3) Subtracting y from x yields 


Multiplication is commutative, therefore xy — yx. 

(5) The complex conjugate of the complex number x = 5 + j7 is x* = 5 — j7. 
Likewise, the complex conjugate of y = 2 — j4 is y* = 2 + j4. 

(6) The modulus of x = 5 + j7 is given by |x| = ~J5 2 + 7 2 = V74- Likewise, 
the modulus of y — 2 — j4 is \y \ = *J2 2 + (— 4) 2 = V 20 . 


x + y = (5 + j7) + (2 - j4) = (5 + 2) + j(7 - 4) = 7 + j3. 


x - y = (5 + j7) - (2 — j4) = (5 - 2) + j(7 - (-4)) = 3 + jll. 


Subtraction is not commutative. In fact, x — y = —(y — x). 

(4) Multiplication of x and y is performed as follows: 


xy = (5 + j7)(2 — j4) = 10 + jl4— j20 — j 2 28 
= (10 + 28) + j(14 - 20) = 38 - j6. 


(7) Dividing x by y yields 


x _ 5+j7 _ (5+j7) (2 + j4) 
y 2 — j4 (2-j4) ' (2 + j4) 


(5)(2) — (7)(4) . (7)(2) + (5)(4) 

2 2 + 4 2 +J 2 2 + 4 2 


18 .34 

20 +J 20 
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B.3 Graphical interpellation of complex numbers 



3 

b 

^ {ab) 

I 

l 

i 


9? 


a 


(a) 


I'y-b 

3 

r / 

/ 1 
/ 1 
X i 

1 
1 



Xe 

i 9? 


r x = a 


(b) 

Fig. B.2. Graphical 
representations for a complex 
number* = a + \b. 

(a) Cartesian representation; 

(b) polar representation. 


Any complex number x = a + )b can be associated with an ordered pair of real 
numbers (a, b), i.e. 


The ordered pair of numbers (a, b) is represented by a point in the Cartesian 
coordinate system as shown in Fig. B.2(a), in which the horizontal axis rep- 
resents the real component 91 of the complex number and the vertical axis 
represents the imaginary component .3 of the complex number. Alternatively, 
the complex number x can be associated with a vector r originating from the 
coordinate (0, 0) and extending to the point ( a , b ). The rules for vector addi- 
tion and subtraction can be used to add and subtract complex numbers, and 
vice versa. Since the two representations are equivalent, it is common to map a 
complex number to a vector. 

Similar to the rectangular and polar representations of a vector, there are two 
alternative and equivalent representations for complex numbers. The rectangu- 
lar representation was introduced in Section B.2. The polar representation is 
derived in Section B.4 by using Fig. B.2(b) and applying the geometric proper- 
ties associated with vectors. Here, we define the notation used in the derivation 
of the polar representation. The length or magnitude of the vector r, shown in 
Fig. B.2(b), is denoted by r |, or simply r. The angle that the vector r makes 
with the positive horizontal axis is denoted by 6. The projection of the vector 
r onto the horizontal axis is denoted by r x , while the projection on the vertical 
axis is denoted by r y . In terms of r and d, the two projections are given by 


Using Pythagoras’s theorem, it is straightforward to prove that the length or 
magnitude r of vector r is given by 


and the angle 0 that the vector makes with the horizontal axis is given by 


ition of complex numbers 

To derive the polar representation of a complex number, we base our discussion 
on Euler’s formula^ 


The polar representation of a complex number x = a + ]b is then defined as 



r x = r cos 9 and r v — r sin6>. 


(B.13) 



(B.14) 


9 = tan \r y /r x ). 


(B.15) 


e 10 = cos 6 + j sin 6*. 


(B.16) 



(B.17) 


' Euler’s formula is named after Leonhard Euler (1707-1783), a prolific eighteenth century Swiss 
mathematician and physicist. 
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where r represents the magnitude or length of the vector r obtained by mapping 
the complex number x onto the Cartesian plane. The length r and angle 0 
associated with vector r are obtained from Eqs (B.14) and (B.15) with r x = a 
and r y = b. We demonstrate the conversion of a complex number from one 
representation to another with a series of examples. 


Example B.2 

Converting rectangular format into polar format Consider a complex num- 
ber x — 2 + j4. Clearly, x is represented in the rectangular format. To derive its 
equivalent polar format, we map the complex number into the Cartesian plane 
and calculate the parameters r and 0. Using Eqs (B.14) and (B.15), we obtain 

r - s/l 1 + 4 2 = V20 


and 


0 = tan *(4/2) = 0.357T radians. 
The polar representation of x = 2 + j4 is x = \/2()ej 0 - 35lr . 


Example B.3 

Converting polar format into rectangular format Consider a complex num- 
ber in the polar format x = 4e J7r/3 . The rectangular representation of x is derived 
using Eq. (B.13) as 


and 

b = r y = 4 sin ^ — J = 2 V3 . 

The rectangular representation of x = 4e J7r/ ' 3 is x = 2 + J2V3. 

In terms of polar representations, the basic arithmetic operations between two 
complex numbers x\ = r le^ 1 and X 2 = r^e , 102 are defined as follows. 


B.4.1 Addition 


Addition of two complex numbers in polar format: 

X! + X 2 = r^ 01 + r 2 e J02 = (rq cos0! + jr { sin0!) + (r 2 cosd 2 + j r 2 sin0 2 ) 
= (ri cos 0i + r 2 cos 0 2 ) + j (r 1 sin 61 + r 2 sin 0 2 ) 


= V (r\ cos 0 i + r 2 cos 0 2 ) + (ri sin 0 i + r 2 sin 0 2 ) 


x exp 


j tan 


r\ sin0! + r 2 sin0 2 


j 1 cos 0i + r 2 cos0 2 

y i ' 1 + r\ + 2 r\r 2 cos(0i - 0 2 ) 

_j / sin 0i + r 2 sin0 2 


x exp 


J tan - 


ri cos 0i + r 2 cos 0 2 


(B.18) 
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B.4.2 Subtraction 


Subtraction of two complex numbers in polar format: 

xi — X 2 — r\^ Bl — r2 e * 02 

= (n cos 0 \ — r2 cos 62 ) + j (n sin 0i — n sin 62 ) 


— -J (r t cos 9\ — r 2 cos 0 2 ) 2 + {r\ sin 0i — r 2 sin 0 2 ) 2 
_i / ri sin 0i — r2 sin 02 


x exp 


J tan 


ri cos 0i — r2 cos 02 


= \J r \ + r 2 - 2r i r 2 cos(0i - 0 2 ) 

j ! r 1 sin 0i — r2 sin 02 


x exp 


J tan 


ri cos 0i — T2 cos 02 


B.4.3 Multiplication 


Multiplication of two complex numbers X| and X2 in polar format: 

xix 2 = r iej 01 • r 2 e i ® 2 
= r\r2^ di+Bl) ■ 


(B.19) 


(B.20) 


B.4.4 Complex conjugation 

The complex conjugate of complex number xi is given by 

x ; = ri e-> Bi . 


(B.21) 


B.4.5 Modulus 


The modulus (or magnitude) of a complex number xi = rie- 1 ' 7 ' is |xi — r\. 


B.4.6 Division 


Dividing two complex numbers in polar format: 

^ = r jf!_ = >1^-92) 
x'2 r 2 ei ° 2 r 2 


(B.22) 


Before we end this section, we note that both rectangular and polar formats 
have their advantages. It is easier to add or subtract complex numbers in the 
rectangular format. Multiplication and division are, however, simpler in the 
polar representation. We illustrate the concepts discussed in Section B.4 with 
the following example. 


Example B.4 

Consider the two complex numbers 

x = 5+j7 = v / 74e i0 ' 3026jr 
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and 

y = 2-j4 = V20e~ jo - 3524 \ 

Repeat Example B.l but by selecting one of the two formats (rectangular or 
polar) for which the arithmetic operation is computationally simpler. 


Solution 

(1) The real and imaginary components of the complex number x are obtained 
from the rectangular format, i.e. IH(x) = 5 and 3(x) = 7. Likewise, for y 
the components are 91(y) = 2 and £S(y) = —4. 

(2) Addition of x and y is performed in the rectangular format as follows: 

* + y = (5 + j7) + (2-j4) 

= (5 + 2) + j(7 — 4) 

= 7-j3. 

If polar format is required, we can express the above answer for ( x + y ) in 
the polar format as x + y = VSSeb™ ‘(-3/7) _ 7.62e _ j° 13,r . 

(3) Subtraction is also performed in the rectangular format as follows: 

x-y = (5 + j7) — (2 — j4) 

= (5 — 2) + j(7 — (—4)) 

= 3— jll. 


Converting the above answer into polar form, we obtain x — y = 
yi 3 Q e j tan- 1 (-11/3) = n.40e' jo - 4157r . 

(4) Multiplication of x and y is performed in the polar format as follows: 

xy = V74e j0 ' 302fe • V20e^ j03524lr 
= \/l480e -j0 ' 04987r . 


(5) 

( 6 ) 
(7) 


The rectangular format is xy = V 1480(cos(0.04987r) + j sin(— 0.04987T)) 
= 38 — j6. 

In rectangular format, the complex conjugate of the complex number x = 
5 + j7 is x* = 5 — j7. Likewise, the complex conjugate of y = 2 — j4 is 
y* = 2 + j4 in rectangular format. The complex conjugates in polar format 
are x* = V74e-j°- 302&r and y* = V20 e j°- 35247r . 

The moduli of x and y are obtained directly from the polar format as 
|x| = V74and |y| = V20. 

Dividing x by y is performed in polar format, yielding 
x ^74^ 0302671 

y y/ 20 e-)° 352471 


= V3J^ 


j0.6557r 


which, in rectangular format, is V3.7 (cos(0.6557r) + j sin(0.6557r)) = 
— 0.9 + jl.7. 
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B.5 Summary 


Complex numbers in rectangular and polar formats were reviewed. Basic arith- 
metic operations such as addition, subtraction, multiplication, division, and 
complex conjugation were illustrated in both rectangular and polar domains. 


Problems 


B.l Calculate the polar representations for (a) 1; (b) j; (c) — 1; (d) — j; (e) 3 + 
j4; (f) 8 — j6; and (g) 12 + j4. 

B.2 Calculate the rectangular representations for (a) 1 1 exp(j2;r); 

(b) 125 exp(j7r/2); (c) 72exp(— j7r); (d) 125 exp(j7r/8); (e) 25.47 
exp(— j37r/4); and (f) 0.85 exp(— j?r/4). 

B.3 Consider the complex function 


g(0 = 


2 + j3 t 
l+j2 f 


B.4 

B.5 


Plot the magnitude and phase of the function g(t) each as a function of the 
independent variable t . 

Determine and sketch the roots of the equation e ' + 10 = 0 in the Cartesian 
plane. [Hint: The polar representation for — 10 = e ln(10)+ ! (2m+1)7r .] 

Prove the following identities: 



eie _ e -j 0 


(ii) sin$ = — ; 

2j 

(iii) e i ” OT = (— l) m and 

e 2 e A 

(tv) cos o = i - — + — 

q3 q5 

(v) sin0 = 9 1 

3! 5! 


^(Imiz+B) _ gjfl. 

e 6 



Appendix C Linear constant-coefficient 
differential equations 


It was shown in Chapters 2 and 3 that linear constant-coefficient differential 
equations play an important role in LTIC systems analysis. In this appendix, 
we review a direct method for solving differential equations of the form 


E 

k = 0 


a k - 


dyjt) 

d t k 


m 


J2 bk 


d k x(t) 
d t k ’ 


where the c// f s and bk s are constants, and the derivatives 


y(t). 


d y(t) d 2 y(t) d n ~ l y{t) 

d t ' d t 2 ’ ' d t"~ l 


(C.l) 


(C.2) 


of the output signal y(t) are known at a given time instant, say t = to- We will 
use the compact notation y(t ) to denote the first derivative of y(t) with respect to 
t. Therefore, y(t) = dy/df, y(t) — dv 2 /df 2 , and similarly for the higher-order 
derivatives. In the context of LTIC systems, the differential equation, Eq. (C.l), 
provides a linear relationship between the input signal x(t) and the output y(t). 
The values of the derivatives of yit), Eq. (C.2), for such LTIC systems are 
typically specified at to = 0 and are referred to as the initial conditions. The 
highest derivative in Eq. (C.l) denotes the order of the differential equation. 
Equation (C.l) is therefore either of order n or m. 

The method discussed in this appendix is direct, in the sense that it solves Eq. 
(C.l) in the time domain and does not require calculation of any transforms. The 
direct approach expresses the output y(t) described by a differential equation 
as the sum of two components: 


(i) zero-input response y z i(t) associated with the initial conditions; 

(ii) zero-state response y zs (t) associated with the applied input x(t). 


The zero-input response y z [(t ) is the component of the output y(t ) of the sys- 
tem when the input is set to zero. The zero-input response describes the manner 
in which the system dissipates any energy or memory of the past as specified 
by the initial conditions. The zero-state response y /s (t) is the component of the 
output y(t ) of the system with initial conditions set to zero. It describes the 
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behavior of the system forced by the input. In the following, we outline the 
procedure to evaluate the zero-input and zero-state responses. 


C.l Zero-input response 


The zero-input response y z ;(f) is the output of the system when the input is 
zero. Hence, y z ;(f) is the solution to the following homogeneous differential 
equation: 


n 


J2 a k 

k = 0 


d k y(t) 
d t k 


= 0 , 


(C.3) 


with known initial conditions 


y(t), 


dy(t) d 2 y(t) d"y(t) 

dr ’ dr 2 ’ ’ dr" 


at r = 0. 


(C.4) 


To determine the zero-input response y z i(t), assume that the zero-input 
response is given by y z ;(f) = 4e A7 , substitute y v \(t) in the homogeneous dif- 
ferential equation, Eq. (C.3), and solve the resulting equation. We illustrate the 
procedure for calculating the homogeneous solution by considering an example. 


Example C.l 

Consider a CT system modeled by the following differential equation: 

d 2 y dy 

^ + 5— + 4 y ( r ) = 3x ( r). (C.5) 

Compute the zero-input response of the system for initial conditions y(0) = 2 
and y( 0) = —5. 


Solution 

Substituting y z j(r) = ,4e ,v ' in the homogeneous equation 

d 2 y dv 

_ + 5 - + 4y(r) = 0, (C.6) 

obtained by setting input x(t) = 0, yields 

Ae s, (s 2 + 5s + 4) = 0. (C.7) 

Ignoring the trivial solution, i.e. assuming Ae' 7 ^ 0, Eq. (C.7) reduces to the 
following quadratic equation, referred to as the characteristic equation, in s: 

s 2 + 5s + 4 = 0, (C.8) 

which has two roots at s = — 1 , —4. The zero-input solution is given by 


y zi (0 = A 0 e ' + Aie 4 ', 


(C.9) 
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where ,4 ( , and A \ are constants to be determined from the given initial condi- 
tions. Substituting the initial conditions in Eq. (C.9) yields 

Aq + A\ = 2 , 

— A 0 -4Ai = -5, (C.10) 

which has solution Aq = 1 and A i = 1. The zero-input response for Eq. (C.5) 
is therefore given by 

y zi (0 = e-'+e“ 4 '. (C.ll) 


C.1.1 Repeated roots 

The form of the zero-input response changes slightly when the characteristic 
equation has repeated roots. If a root s = a is repeated J times, then we include J 
distinct terms in the zero-input response associated with a by using the following 
J functions: 


e at , fe°', t 2 e at , . . . , t J ~ 1 e at . (C.12) 

The zero-input response of an LTIC system is then given by 

y zi (0 = A 0 e fl ' + A\te at + A 2 t 2 e a ‘ + ■ ■ ■ + A y _ 1 r / - I e flf . (C.13) 

The procedure for calculating the homogeneous solution for differential 
equations with repeated roots is illustrated in Example C.2. 


Example C.2 

Consider a CT system modeled by the following differential equation: 

d 3 y d 2 v dv 

d^ +4 d^ +5 i +m)=x{t) - (C14) 

Compute the zero-input response of the system for initial conditions y(0) = 4, 
y(0) = -5, y(O) = 9. 


Solution 

By substituting y z i(t) = Ae st in the homogeneous representation forEq. (C. 14), 
we obtain the following characteristic equation: 

s 3 + 4s 2 + 5s + 2 = 0, (C.15) 

which has three roots at s = —1, —2, —2. The zero-input solution is therefore 
given by 


y zi (t) = A 0 e ' + Aie 21 + A 2 re 21 , 


(C.16) 
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where Ao, Ai, and A 2 are constants determined from the given initial conditions. 
Substituting the initial conditions into Eq. (C.16) yields 

A 0 + Aj = 4, 

-Ao + Aj -2A 2 = -5, (C.17) 

A 0 - 2A\ +4A 2 = 9, 


which has solution Ao = 1, A\ =2, and A 2 = 3. The zero-input response for 
Eq. (C.14) is therefore given by 


y zi (/) = e -' + 2e- 2 ' + 3fe- 2 '. (C.18) 


C.1.2 Complex roots 

Solving a characteristic equation may give rise to complex roots of the form 
s = a + }b. Typically, a homogeneous differential equation, Eq. (C.3), with real 
coefficients, has complex roots in conjugate pairs. In other words, if s = a + )b 
is a root of the characteristic equation obtained from Eq. (C.3) then s = a — )b 
must also be a root of the characteristic equation. For such complex roots, the 
zero-input response can be modified to the following form: 

y zi (t) — A 0 e a ' cos (bt) + A ie, at sin (bt). (C.19) 


Example C.3 

Compute the zero-input response of a system represented by the following 
differential equation: 


d 4 y d 2 y 

— — + 2 — 
dr 4 d t 2 


+ 1 = x(t), 


with initial conditions y(0) = 2, y(0) = 2, y(0) = 0, y(0) = —4. 


(C.20) 


Solution 

Substituting y z i(t) = Ae s ‘ in the homogeneous representation for Eq. (C.20) 
results in the following characteristic equation: 

s 4 + 2s 2 + 1 = 0. (C.21) 

The roots of the characteristic equation are given by s = j, j, — j, and — j. Note 
that the roots are not only complex but also repeated. The zero-input solution 
is given by 


y zi (f) = Aocos(f) + Ait cos(f) + A 2 sin(f) + A^t sin(f), 


(C.22) 
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where ,4 o , Ai, A 2 , and A 3 are constants. To calculate these constants, we sub- 
stitute the following initial conditions: 

A 0 

At +a 2 

— Ao + 2A3 

-3Aj - A 2 

which has solution Ao = 2, Ai = 1, A 2 = 1, and A 3 = 1. The zero-input 
response for the system in Eq. (C.20) is therefore given by 

y z i(f) = 2cos(f) + t cos (t) + sin(f) + t sin(f)- (C.24) 


= 2 , 
= 2 , 
= 0 , 
= -4, 


(C.23) 


C.2 Zero-state response 


The zero-state response y zs (t ) depends upon the input signal x(f) subject to 
zero initial conditions. The zero-state response consists of two components: 
(i) the homogeneous component y® (f ) and (ii) the particular component y£ 5 (0. 
The homogeneous component is obtained by following the procedure used to 
solve for the zero-input response but with zero initial conditions. The particular 
component of the zero-state response is obtained from a look-up table such as 
Table C.l. For example, if the input signal is x(t) = Ke at , then the partic- 
ular component of the zero-state response is assumed to be y®(f) = Ce.~ at . 
The constant C is determined such that y z ;(f) satisfies the system’s differential 
equation. The procedure for computing the zero-state response is illustrated in 
Example C.4. 

Example C.4 

Consider the system specified by the differential equation given in 
Example C. 1 : 

d 2 y dy 

-^ + 5 —+4y(t) = 3x(t). (C.25) 

Compute the zero-state response of the system for the input signal x(t) = 
cos tu(t). 

Solution 

The homogeneous and particular components of the zero-state response y z ;(f) 
are solved separately in three steps as follows. 

Step 1 Compute the homogeneous component y®(?) The solution for the 
homogeneous component is similar to the zero-input response of the system. 
Using the result of Eq. (C.9), the homogeneous component of the zero-input 
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Table C.l. Zero-state response corresponding to common input signals 


Input 

Particular component of the 
zero-state response 

Impulse function, KS(t ) 

CS(t ) 

Unit step function, Ku(t) 

Cu(t) 

Exponential, Ke~ at 

Ce~ at 

Sinusoidal, A cos(wo t + 4>) 

Co cos(a>o t) + Cisin(cuor) 


response is given by 

y^\t) = B 0 c~‘ + B^- 41 , (C.26) 

where Bq and B\ are constants. 


Step 2 Determine the particular component y?%{t) The particular com- 
ponent is obtained by consulting Table C.l. For the input signal x(t) = 
cos t u(t), the particular component of the zero-state response is of the form 
jzsV ) = Co cos t + Ci sin t for t > 0. Substituting the particular component in 
Eq. (C.25) yields 

(— 5Co + 3Ci)sinf + (3Co + 5Ci)cosf = 3cos t. (C.27) 

Equating the cosine and sine terms on the left- and right-hand sides of the 
equation, we obtain the following simultaneous equations: 

-5C 0 + 3Ci = 0, 

3C 0 + 5Ci = 3, (C.28) 

with solution Co = 9/34 and C\ — 15/34. The particular component yy!/(f ) of 
the zero-state response is given by 

y^(t) = ^ cost + ^ sin t for t > 0. (C.29) 

Step 3 Determine the zero-state response from y /s (t) = y®(t) + 

The zero-state response is the sum of the homogeneous and particular com- 
ponents, and is given by 

y zs (t) = ( B 0 e~ ' + Bie -4 ') + ^ cosf + ^ sin C (C.30) 

where Bo and B\ are obtained by inserting zero initial conditions, y(0) = 0 and 
y(0) = 0. This leads to the following simultaneous equations: 

Bo + Bl = ~Ia' 

15 

B 0 + 4B l = — , 


(C.31) 
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with solution Z?o = — I /2 and B\ = 4/17. The zero-state response of Eq. (C. 25) 
is 


1 4 ,, 9 15 

y (t) = — e H e -| cost-] sinf. (C.32) 

J 2 17 34 34 

This approach for finding the particular component of the zero-state response 
is modified when the input is of the same form as one of the terms in the homo- 
geneous component of the zero-state response. We illustrate with an example 
where we outline the modified procedure for calculating the particular compo- 
nent of the zero-state response. 

Example C.5 

Repeat Example C.4 for the input signal x(t) = 2e~' . 

Solution 

The homogeneous component for the zero-state response is given by Eq. (C.26): 

y£>(t) = B 0 e + B ie - 4 ', 


where Bq and B\ are constants. The input signal x(f) = 2e - '. Based on 
Table C.l, the particular component is of the form y^(r) = Ce~ ! , which is 
similar to the first term in the homogeneous component. In such a scenario, we 
assume a particular component that is different from the first term of the homo- 
geneous component. To achieve this, we multiply the particular component by 
the lowest power of t that will make the particular component different from the 
first term of the homogeneous component. The particular component, in this 
example, is therefore given by y Z s(t) — Cte~' . In order to evaluate the value of 
constant C, we substitute the particular component in the system’s differential 
equation and solve for C; it is found that C — 3. The overall zero-state response 
is therefore given by 


y zs (t) = floe"' + Bie- 4 ' + 3 fe~ r , (C.33) 

where the values of Bq and B\ are computed using zero initial conditions. The 
resulting simultaneous equations are given by 


Bq -f B\ = 0, 
Bq + AB\ = —3, 


(C.34) 


which has solution Bq = 1 and B\ = —1. The overall zero-state response is 
given by 


y zs (t) = e r - e 4 ' + 3 fe ' . 
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C.3 Complete response 


The complete response of an LTIC system is the sum of the homogeneous and 
particular components. The procedure for calculating the complete response 
consists of the following steps. 

( 1 ) Compute the zero-input response y z i(t) of the system using the given initial 
conditions. 

(2) Compute the zero-state response y zs (r) of the system using zero initial 
conditions and the input signal. The zero-state response is obtained by 
determining its homogeneous and particular components. 

(3) Add the zero-input and zero-state responses of the systems to get the com- 
plete response. 

Example C.6 

Calculate the output of an LTIC system represented by the following differential 
equation: 

d 2 y dv 

4 + 5 t- +4y(0 = 3*(f), (C.35) 

dr- dr 

for the input signal x(t) = cost u(t) and the initial conditions y(0) = 2 and 
m = -5. 

Solution 

The zero-input response was calculated in Example C.l and is given by 
Eq. (C.ll), repeated below: 

yzi(0 = e-' + e- 4 '. (C.36) 

The zero-state response was calculated in Example C.4 and is given by 
Eq. (C.32), repeated below: 

1 4 ,, 9 15 

yzs(t) = --e + — e 4 + — cosr+ — sinr. (C.37) 

The complete response is the sum of Eqs (C.36) and (C.37) and is given by 

1 21 9 15 

y(t) — -e + — e 4 + — cosr + — Sinr (C.38) 


for r > 0. 


Appendix D Partial fraction expansion 


An alternative approach to convolution, used in calculating the output response 
of a linear time-invariant (LTI) system, is to calculate the product of appropri- 
ately selected transforms of the convolving signals and then evaluate the inverse 
transform of the product. In most cases, the transform-based approach is more 
convenient as it leads to a closed-form solution. It is therefore important to 
develop methods to compute the inverse of a specified transform to determine 
the output response of the LTI system in the time domain. For transforms that 
can be expressed as a rational function of two polynomials, the partial fraction 
expansion simplifies the evaluation of the inverse transform by expressing the 
rational function as a summation of simpler terms whose inverse is obtained 
from a look-up table. This appendix focuses on the partial fraction expansion 
of a rational function. The partial fraction expansion techniques for the four 
transforms, namely the Laplace transform, the continuous-time Fourier trans- 
form (CTFT), the z-transform, and the discrete-time Fourier transform (DTFT), 
covered in the text are presented separately in Sections D.1-D.4. 


where the numerator N(s ) is a polynomial of degree m and the denominator 
D(s) is a polynomial of degree n. If m >n, we can divide N (,v ) by D(s) and 
express X (,v ) in an alternative form as follows: 


D.l Laplace transform 


Consider a function X(i) of the form 


X(s) = 


N(s ) b m s m + b m _ 1 s m 1 H 1- b\s + b 0 


(D.l) 


D(s) a„s n + a„-\s n 1 + ■ • • + cqs + «o 



m—n 


(D.2) 
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Ifm < n, there is no summation terminEq. (D.2) and fVi(s) = /V(,v). The partial 
fraction expansion represents the rational fraction Ni(s)/D(s ) as a summation 
of simpler terms. 

The first step in obtaining the partial fraction expansion is to factorize the 
denominator polynomial and express the function X (s ) as follows: 


Ni(s) = N&) 

D(s) (S ~ P\)(S - p 2 ) ■ ■ ■ (S ~ p n )’ 


(D.3) 


where pi, p 2 , ■ ■ ■ , p n are the n roots of the characteristic equation. 


D(s) — ®nS U + ®n—\S U “h • • • T tqs T — 0. (D.4) 


If X(s) represent the transfer function of an LTIC system, then the roots pi. 
Pi, ■ ■ ■ , Pn of the characteristic equation are the poles of the system. The partial 
fraction expansion expresses Eq. (D.3) as the following summation: 

N\(s) k\ k 2 k n 

+ + (D.5) 

D(s) s - pi s - p 2 s - p n 

where k r , for 1 < r < n, is referred to as the coefficient (also known as the 
residue) of the r th partial fraction. Depending on the nature of the poles, different 
procedures are used to compute the partial fraction coefficients k r . We consider 
two cases in the following sections. 


D.1.1 First-order poles The poles p\, p 2 , . . . , p„ are of the first order if they 
are not repeated. In such cases, the value of the rth partial fraction coefficients 
k r can be calculated from the Heaviside formula:' 

(D.6) 

s=p r 

We illustrate the application of the formula with four examples. 

Example D.1 

For the function 


k r = 


(s - Pr ) 


Ni(s) 
D(s ) . 


X(a) = 


4s 2 + 20s - 2 
s 3 + 3s 2 — 6s — 8 ’ 


(D.7) 


(i) calculate the partial fraction expansion; 

(ii) based on your answer to (i), calculate the inverse Laplace transform of 
X(s). 


' This formula is named after Oliver Heaviside (1850-1925), an English electrical engineer, 
mathematician, and physicist, who developed techniques for applying the Laplace transforms to 
the solution of differential equations. 
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Solution 

(i) The characteristic equation of X(s) is given by 
s 3 + 3 s 2 — 6s — 8 = 0, 


which has roots at s = —1, 2, and —4. The partial fraction expansion of X (s ) 
is therefore given by 

4s 2 ■ 

X(s) = 


20s 


+ 3 s 2 — 6s — 8 s + 1 s — 2 s + 4 


Using the Heaviside formula, the residues k r are given by 


and 


h = 


k i = 

k 2 = 

4 s 2 4 


4s 2 + 20s 


(s - 2)(s + 4) 
4s 2 4- 20s - 2 


4-20-2 


(s + l)(s+4) 


S=— 1 


s=2 


-9 

16 + 40-2 
3x6 


= 2 , 


= 3, 


20s - 2 


(s + l)(s - 2) 


s =— 4 


64- 80-2 -18 

(-3) x (-6) ~ “l8~ 




Substituting the values of the partial fraction coefficients k\, k 2 , and k 2 , we 
obtain 


X(s) = 


1 


s + 1 s — 2 


(D.8) 


(ii) Assuming the function x(t ) to be causal or right-sided, we use Table 6. 1 
to determine the inverse Laplace transform x(t) of the ATs) as follows: 


(t)= (2e"'+3 e 2 ' -e^ 4 ')«(f). 


(D.9) 


Example D.2 

For the function 


6s 2 + 11s + 26 
(i) “ s 3 + 4s 2 + !3s’ 


(D.10) 


(i) calculate the partial fraction expansion; 

(ii) based on your answer to (i), calculate the inverse Laplace transform of 
X(s). 

Solution 

(i) The characteristic equation of X(s ) is given by 

s 3 + 4s 2 + 13s = 0, 
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which has roots at s = 0, —2 + j3, and —2 — j3. The partial fraction expansion 
of A(s) is therefore given by 


6s 2 + 1 Is + 26 
^ ^ s 3 + 4s 2 + 13s 


k i ki k'l. 

1 — H — . 

s s + 2 + j3 s T 2 — j3 


(D.ll) 


Note that in this case, there are two complex-conjugate poles at s = —2 ±j3. 
Using the Heaviside formula, the residues k r are given by 


k i = 


ko — 


(s + 2+j3) 


6s 2 + 1 Is + 26 
_ s(s + 2 + j3)(s + 2 — j3) 
6s 2 + 1 Is + 26 


= 2 , 


s = 0 


s(s + 2 + j3)(s + 2 — j3) 


s=-2-j3 


= 2 — j — , 
J 6 


and 


h = 


(s + 2+j3) 


6s 2 + 1 Is + 26 


s(s + 2 + j3)(s + 2 — j3)J i= _2 + j3 


= 2+j 6' 


Substituting the values of the partial fraction coefficients k\, kj, and £3, we 
obtain 


2 2 — j? 2+j 2 

X(s) = - + . 

s s + 2+j3 s + 2 — j3 


(D.12) 


(ii) Assuming the function x(t ) to be causal or right-sided, we use Table 6. 1 
to determine the inverse Laplace transform x(f) of the A'(s) as follows: 


x(t) = 


2 

2 + e“ 2 ' 


2 — j- ) e _(2+j3)f 


2 _ ' 6 J ° 


2+j- )e- ( 2 -j 3) ' 


2 +j-)e> 3f 


2 + e 


-2 1 


2 (e j3 ' + e- j3 ') + J 2 (d 3 ' - e" j3f ) 


u(t) 

u(t) 

nit) 


2 + e 


- 2 / 


4cos(3f) — - sin(3f) 


2 + 4e cos(3 1) — -e “ sin(3f) 


u(t) 

u(t). 


(D.13) 


In Example D.2, the complex- valued poles of the Laplace transform A(s) occur 
in conjugate pairs. This is true, in general, for any polynomial with real-valued 
coefficients. Although the Heaviside formula may be used to determine the 
values of the partial fraction residues corresponding to the complex poles, the 
procedure is often complicated due to complex algebra. Below, we present 
another procedure, which expresses such complex-valued and conjugate poles 
in terms of a quadratic term in the partial fraction expansion. 
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Example D.3 

Repeat Example D.2 by expressing the complex-valued poles as a quadratic 
term. 


Solution 

(i) Combining the complex- valued terms in Eq. (D. 11), 

6 s 2 + 11 s + 26 k\ k 2 £3 

^ s 3 + 4s 2 +13s s s + 2 + j3 + s + 2 — j3 ’ 

_ k\ (fe + k^) s + 2 (&2 + ^ 3 ) 

~~ 7 (s + 2) 2 - (j3 ) 2 


Since £ 2 and £3 are constants, their linear combinations can be replaced with 
other constants. Substituting fc 2 + £3 = A\ and £: 2 + £3 = A 2 , we obtain 


X(s) = 


6s 2 


11s + 26 


Ais + A 2 


s 3 +4s 2 +13s s s 2 + 4s + 13 


(D.14) 


It may be noted that the above expression could have been obtained directly by 
factorizing the denominator. 


s 3 + 4s 2 + 13s = s(s 2 + 4s + 13), 


and writing the partial fraction expansion of X(s) in terms of two terms, one 
with a linear polynomial s in the denominator and the other with a quadratic 
polynomial (s 2 + 4s + 13). 

The partial fraction coefficient k\ of the linear polynomial denominator is 
obtained using the Heaviside formula as follows: 


k 1 


6s 2 + 1 Is + 26 
s(s 2 + 4s + 13) _ J=0 


In order to calculate the remaining coefficients A 1 and A 2 , we substitute k\ — 2 
in Eq. (D.14). Cross-multiplying and equating the numerators in Eq. (D.5), we 
obtain 


6s 2 + 11 s + 26 = 2(s 2 + 4s + 13) + (Ajs + A 2 )s 


or 


(Ai + 2)s 2 + (A 2 + 8)s + 26 = 6s 2 + 1 Is + 26. 

Equating the coefficients of the polynomials of the same degree on both sides 
of the above equation, we obtain: 

coefficient ofs 2 (Ai + 2) = 6, A 1 = 4; 

coefficient ofs (A 2 + 8) = 11, A 2 = 3. 
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Substituting the values of the partial fraction coefficients k\, A\, and A 2 in Eq. 
(D.14) yields 


2 

X(s) = - 
s 


4s + 3 
(s + 2) 2 + 9 ' 


(D.15) 


(ii) The Laplace transform X(s) is rearranged: 

2 4(s + 2) 5 3 

s (s + 2) 2 + 9 3 (s + 2) 2 + 9 ’ 


such that the second and third terms are in the same form as entries (13) and 
(14) in Table 6.1. Taking the inverse transform gives the following transform 
pairs: 


x(t) = 


2 + 4e~ 2 ' cos(3f) - 



sin(3f) 


u(t). 


(D.16) 


Note that the inverse Laplace transform x(t) obtained in Eq. (D.13) is identical 
to the answer obtained in Example D.2. The procedure followed in Example D.3 
avoids complex numbers and is preferable. In cases where the roots of the char- 
acteristic equations are complex-valued, we will express the Laplace transform 
directly in terms of partial fraction terms with quadratic denominators. 


Example D.4 

For the function 


H(s) = 


2 s 3 + 10s 2 + 8s - 18 
s 3 + 3s 2 — 6s — 8 


(D.17) 


(i) calculate the partial fraction expansion; 

(ii) based on your answer to (i), calculate the inverse Laplace transform of 

X(s). 


Solution 

(i) Since the degree of both the numerator and denominator polynomials is 
3, we divide the numerator polynomial by the denominator polynomial and 
express H (s) as follows: 


H(s) = 2 + 


4s 2 + 20s - 2 
s 3 + 3s 2 — 6s — 8 

v — v- ' 

X(s) 


The second term in H(s ) is the same as the rational fraction X (s ) specified in 
Example D.l. Using the results of Example D.l, the partial fraction expansion 
of H(s) is given by 


H(s) = 2 + 



3 


s — 2 


1 

s +4' 


(D.18) 
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(ii) Assuming that the inverse Laplace transform x(t ) is right-sided, we use 
Table 6.1 to determine the inverse Laplace transform x(t) of the X(s): 

h{t) = 23(f) + (2e“ f + 3e 2f - e“ 4 >(f)- (D.19) 


D.1.2 Higher-order poles The residues in a partial fraction can be calculated 
using the Heaviside formula in Eq. (D.4) when the poles are not repeated. 
However, when there are multiple poles at the same location, Eq. (D.4) cannot 
be directly used to calculate the coefficients corresponding to the fractions at 
multiple pole locations. To illustrate the partial fraction expansion for repeated 
poles, consider a Laplace transform Ai(s) with r— 1 unrepeated poles at ,v = 
pi, P 2 , ■ ■ ■ , Pr-i and q repeated poles at ,v = p r . To be consistent with the 
rational fraction expression in Eq. (D.l),r — 1 + q = n . The Laplace transform 
Ai(s) can be expressed as follows: 


Nijs) = Nds) 

D(s) (s - pi)(s - pi) ■ ■ ■ (s - p r -i)(s - p,.) q ' 


(D.20) 


The partial fraction expansion of the above rational function is given by 


Ni(s) 

D(s) 


<•1 


ki 


S - Pi S - P 2 

k r ,q 


+ 


kr- 


Pr-l 


(S - P rf 


k r , i k r 2 

Pr iS - p r f 

(D.21) 


The coefficients k\, k 2 , k 2 , . . . and k r _\ corresponding to the unrepeated roots 
can be calculated using the Heaviside formula, Eq. (D.6). The last coefficient 
k r q can also be calculated using Eq. (D.6) as follows: 


krn = 


is ~ Prf 


Nijs) 
Dis ). 


(D.22) 


However, the coefficients k r m for 1 < m < (q — 1 ), corresponding to the 
repeated poles, cannot be calculated using Eq. (D.6). Instead, these coefficients 
are calculated using the following formula 


h — 

m — 


l 

iq — m ) ! 


' d«- 

d.?4 - 


~{S ~ Prf 


Niisf 

Dis)_ 


for 1 < m < iq — 1). 


(D.23) 


Example D.5 

For the function 


v , s 3 + 10.? 2 + 27i + 20 

A(i) = r 

is + l)(s + 2) 3 


(D.24) 


(i) calculate the partial fraction expansion; 

(ii) based on your answer to (i), calculate the inverse Laplace transform of 
X(s). 
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Solution 

(i) The partial fraction expansion of Eq. (D.24) is given by 

s 3 T 10s- T 27s T 20 k\ ^ 2,1 ^ 2,2 ^ 2,3 


X(s) = 


(s + l)(s + 2 ) 3 s + 1 s + 2 (s + 2) 2 (s + 2) 3 ' 

The partial fraction coefficient k \ is calculated using the Heaviside formula, 
Eq. (D.6), as follows: 


h = 


s 3 + 10s 2 + 27s + 20 


(s + 2) 3 


S=— 1 


_ 2 _ 
_ T 


The partial fraction coefficient k r 3 is calculated using Eq. (D.22) as follows: 


^2,3 = 


s 3 + 10s 2 + 27s + 20 


s + 1 


40-54 + 20 


s =— 2 


1 


= 2. 


The remaining partial fraction coefficients are calculated using Eq. (D.22) as 
follows: 

's 3 + 10s 2 + 27s + 20' 


£2,2 


1 d 

(3 - 2)! ch 
1 


s + 1 


t =-2 


(S + l ) 2 


(s + 1) — (s J + 10s + 27s + 20) 
ds 


-(s 3 + 10s 2 + 27s + 20) — (s + 1) 
ds 


1 


and 


(s + l ) 2 
1 

(s + l ) 2 


ki.i = 


- J s =— 2 

[(s + l)(3s 2 + 20s + 27) - (s 3 + 10s 2 + 27s + 20)] 


s =— 2 


[2s 3 + 13s 2 + 20s + 7] 


= 3 


s =-2 


1 d 2 r S 3 + 10s 2 + 27s + 20' 


(3 - 1)! ds 2 _ 


s + 1 


s =— 2 


1 d 

2 ds 


r 2s 3 + 13s 2 + 20s + 7 
(s + l ) 2 


J ) s =- 2 


1 


— — . (s+ l ) 2 — (2s 3 + 13s 2 + 20s + 7) 
(s + l ) 4 |_ ds 


-(2s 3 + 13s 2 + 20s + 7) — (s + l ) 2 
ds 


s =— 2 


1 


^+i)^ 

=1 


(s + l ) 2 ( 6 s 2 + 26s + 20 ) 
L =1 =-8 


- (2s 3 + 13s z + 20s + 7) (2s + 2) 

=3 =— 2 . 


s =—2 


= -{—8 + 6 } = — 1 . 
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Therefore, the partial fraction expansion for A(s) is given by 
2 13 2 

X(s) = 


s 1 s -}- 2 


(D.25) 


(s + 2) 2 (s + 2) 3 ' 

(ii) Assuming that the inverse Laplace transform x(t ) is right-sided, we use 
Table 6.1 to determine the inverse Laplace transform x(t) of the X (s ) : 


x(t) = (2e ' 


,-2 1 


3 te 


r 2 e 2r )u(t ) 


= [2e-' + (f 2 


3f 


l)e- 2 '] M (f). 


(D.26) 


D.2 Continuous-time Fourier transform 


The partial fraction expansion method, described above, may also be applied 
to decompose the CTFT functions to a summation of simpler terms. Consider 
the following rational function for CTFT: 

N(co) b m (icor+b m . l (ico) m - 1 + --- + b 1 (ico) + b 0 

X(co) = = — j , (D.27) 

D((o) a n (jco) n + a n -\(]Q)) n H hfli(jtw) + ao 

where the numerator N (to) is a polynomial of degree m and the denominator 
D(to) is a polynomial of degree n. If m > n, we can divide N(to) by D(o>) and 
express X(co) as follows: 


X(oj) = ^ot £ (jw) e - 


i = o 


Ni(a>) 

Xi(a>) 


(D.28) 


The procedure for decomposing X i (o>) in simpler terms remains the same as 
that discussed for the Laplace transform, except that the expansion is now made 
with respect to (jrw). For example, if the denominator polynomial I)(o>) has n 
first-order, non-repeated roots, p\, p 2 , . . . , p„, such that 


Xi («) = 


Ni(a>) 


Ni(a>) 


D(0>) ()(0 - pi)()(0 - p 2 )- ■ ■ (}CO - p n ) 

the function X\(of) may be decomposed as follows: 

N i(®) k\ k2 k n 


D(co) jcu - pi j<u - p 2 


+ 


JO> - Pn 


(D.29) 


(D.30) 


where the partial fraction coefficients k r are calculated using the Heaviside 
formula: 


k r 



Pr ) 


Nl(t0) 

D(co) 


-*)lO= Pr 


Using the CTFT pair 


'u(t) 


CTFT 


1 


a + )to 


(D.31) 
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the inverse CTFT of Eq. (D.30) is given by 


x\(t) = (k l e p ' t + k 2 e P2 ' + ■ ■ ■ + k n e p ’ ,, )u(t). (D.32) 

Similarly, the complex roots and repeated roots may be expanded in partial 
fractions by following the procedure outlined for the Laplace transform. 

Example D.6 

Using the partial fraction method, calculate the inverse CTFT of the following 
function: 


X{co) = 


2( ja>) + 7 

(» 3 + 10(j«) 2 + 31(» + 30' 


(D.33) 


Solution 

The characteristic equation of X(o>) is given by 

(j«) 3 + 10(j®) 2 + 31(jo>) + 30 = 0, 


which has roots at }a> = —2, —3, and —5. The partial fraction expansion of 
X (oi) is therefore given by 


*(©) = 


2( j co) + 7 

( jco + 2)( jcu + 3)(j® + 5) 


k i k 2 

1 

}m + 2 }co + 3 


h 

j® + 5' 


The partial fraction coefficients are calculated using the Heaviside formula: 


ki 


k 2 = 



+ 2 ) 


2( ]io) + 7 

(ja> + 2)(jw + 3)(jw + 5) 



= 1, 


(j« + 


3) 


2( jfi>) + 7 

(ja> + 2)(jw + 3)(jo; + 5) 



1 

2 ’ 


and 


k 3 = 


(j® + 5) — 


2(j ®) + 7 


](o — — 5 


(j® + 2)(jtt> + 3)(jw + 5). 
Therefore, the partial fraction expansion of X (of) is given by 

111 11 

X(o>) = - 


jw + 2 2 (jw + 3) 2 (jcu + 5) 

Using Table 5.2, the inverse DTFT x{t) of X(co) is given by 


(D.34) 




u(t). 


x(t) = 


(D.35) 
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Example D.7 

Using the partial fraction method, calculate the inverse CTFT of the following 
function: 


X(a>) = 


4(jco) 2 + 20(jco) + 19 
(j«) 3 + 5(j&>) 2 + 8(jco) + 4* 


(D.36) 


Solution 

The characteristic equation of X(a>) is given by 

(j«) 3 + 5( jco) 2 + 8( jco) + 4 = 0, 


which has roots at jco = — 1, —2, and —2. The partial fraction expansion of 
X (co) is therefore given by 


X(co) = 


4(jw) + 20(jtw) + 19 


^ 2,1 


ki,2 


(jco) 3 + 5(jco) 2 + 8(jco) + 4 (jco+1) (jco + 2) (jco + 2) 


2 ■ 


The partial fraction coefficients k\ and + 2.2 are calculated using the Heaviside 
formula: 

4(jco) 2 + 20(jco) + 19 


and 


k 1 = 


k-2,2 = 


(jco+ 1) 


(jco+l)(jco + 2) 2 


= 3 


](jO=—\ 


(jco + 2) 


2 4(jco) 2 + 20(jco) + 19 

(jco+ 1) (jco + 2) 2 2 


= 5. 


The remaining partial fraction coefficient is calculated using Eq. (D.23): 


ki,\ 


1 


( 2 - 1 )! 


d 4(jco) 2 + 20(jco) +19 


d(j«) 


(jffl+D 


(D.37) 


jco — — 2 


where the differentiation is with respect to jco. To simplify the notation for 
differentiation, we substitute s = jco in Eq. (D.37) to obtain: 


& 2,1 = 


1 


d 4.v 2 + 20s + 19 


s =— 2 


(2-1)! Ids (s + 1) 

(s + l)(8s + 20) - (4s 2 + 20s + 19) 

(s + l ) 2 . 


= 1 . 


s ——2 


The partial fraction expansion of X(co) is therefore given by 


X(co) = 


1 


4(jco) 2 + 20(jco) + 19 3 | ^ 

(jco) 3 + 5(jco) 2 + 8(jco) + 4 (jco +1) (jco + 2) (jco + 2) 2 ' 

(D.38) 


Using Table 5.2, the inverse CTFT x(t) of X(o>) is given by 


x(t ) = [3e ' + e 21 + 5 fe 2, ]u{t). 


(D.39) 
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D.3 Discrete-time Fourier transform 


To illustrate the partial fraction expansion of the DTFT, consider the following 
rational function: 


X(f2) = 


N(f2) 

D(Q) 


b m & mSi + b m _ie + • • ■ + b^ n + b 0 
a n ei' ,n + dn-iett"- 1 ) 0 + • • • + a\& n + ciq 


(D.40) 


where the numerator N (SI) is a polynomial of degree m and the denominator 
D(SJ) is a polynomial of degree n. An alternative representation for Eq. (D.40) 
is obtained by dividing both the numerator and the denominator by e)’ lU as 
follows: 


X(f2) = 


N(H) 

D(O) 


j {m _ n)si _ b m + fr m -ie--» n + • • ■ + fete- + b 0 e~ 

a„ + a„-\e~ ]Si + • • • + aie~j (,!_1)fi + aoe~i nn 

~~ V 


X'(co) 


(DAI) 

We need to express Eq. (D.41) in simpler terms using the partial fraction expan- 
sion with respect to e ^ ft . To simplify the factorization process, we substitute 

Z = e i fi : 


, (m _„) b,„ + b m -iz H b biz ( !) + b 0 z 

X(z) = Z K ’ ■ 7 7 77 

a n + c/n-iZ " 1 H h aiz~ (n ~ 1) + a 0 z~ n 


(D.42) 


The process for the partial fraction expansion of Eq. (D.41) is the same as for 
the CTFT and Laplace transform, except that the expansion is performed with 
respect to z _1 . Below we illustrate the process with an example. 


Example D.8 

Using the partial fraction method, calculate the inverse CTFT of the following 
function: 


X(Q) = 


N (SI) 
D(O) 


2e> 2n - 5e jn 

ei2« _ ( 4 / 9 )ejfi + (1/27)' 


(D.43) 


Solution 

Dividing both the numerator and the denominator of Eq. (D.43) by e) 2Q yields 

2 - 5e~j fi 


X(f2) 


1 — (4/9)e-J« + (l/27)e- 2 j"‘ 


Substitute z = in the above equation to obtain 


X(z) = 


2-5z 


-i 


1- (4/9)z-‘ + (l/27)z- 2 ’ 

with the characteristic equation 

4 I , ,4 1 

1 — -z 1 + — z =0 or z 2 - -z + — — 0, 
9 27 9 27 
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which has two poles at z = 1/3 and 1 /9. The partial fraction expansion of X(z) 
is therefore given by 

2 - 5z _1 k\ k 2 

X(z) = 


(1 - (l/3)2-l)(l - (1/9)2-!) 1- (1/3)2“! 1 -(1/9)2-! • 

Using the Heaviside formula, the partial fraction coefficients are given by 


and 


k\ = 


k 2 = 


(1 - (l/3)z -1 ) 


2 — 5z 


-1 


(1- (1/9)2-*) 


(1 — (1/3)2 _1 )(1 — (1/9)2 _1 ) J.-1 =3 
2 - 52 “* 


39 

’~2 


(1 - (l/3)2-!)(l - (1/9)2- 1 )J z - 1=9 
The partial fraction expansion of Eq. (D.43) is given by 
39 1 43 1 


43 

~ 2 ' 


X(z) = 


2 1 


(1/3)2“' 2 1 -(1/9)2-!' 

We substitute 2 = e 1 * 2 = 2 to express the above equation in terms of the discrete 
frequency 17 as follows: 

39 1 43 1 

X(f2) = 


2 1 — (l/3)e-i« 2 1-(l/9)e-J fi 

Using Table 11.2, the inverse DTFT x [£] of X(e ,f/ ) is given by 


x{t) = 


39 /I 


43 /I 


u[k]. 


(D.44) 


D.4 The z-transform 


The partial fraction expansion method can also be applied to evaluate the inverse 
transform of the z functions. Consider a z function of the following form: 


X(z) = 


N(z) 

D(z ) 


b m z m + b m -\z m 1 H h b\z + bo 

a„z n + a„- 12 "-' H h fli 2 + a 0 


(D.45) 


or 


X(z) = 


N(z ) = b m + b m _ x z~ x + ■ ■ ■ + bi 2 - (m -!! + b 0Z ~ m 
D(z ) ~ a„ + a n -iz~ l H h a\z~ (n ~ 1) + a 0 z~ n 


(D.46) 


Either of the two forms, Eq. (D.45) or Eq. (D.46), may be used to calculate 
the partial fraction expansion and eventually the inverse z-transform. If we use 
the format specified in Eq. (D.45), the partial fraction of the function X{z)/z is 
performed with respect to 2 . As illustrated in Example D.9, the partial fraction 
of X(z )/z leads to expansion terms for which the inverse z-transform is readily 
available in Table 13.1. If instead Eq. (D.46) is used, the partial fraction of the 
function X(z) is performed with respect to 2 1 . We illustrate the procedure for 
both formats in Examples D.9 and D.10. 
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Example D.9 

Using Eq. (D.45) for the partial fraction expansion, calculate the inverse 
z-transform of the following function: 


X(z) = 


z 2 - 3 z 

z 3 -z 2 + 0. 17z + 0.028' 


(D.47) 


Solution 

The transform X(z ) is expressed in the following form: 

X(z) z - 3 

z ~~ z 3 -z 2 + 0. 17z + 0.028’ 


(D.48) 


which has poles at z = —0.1, 0.4, and 0.7. The partial fraction expansion of 
Eq. (D.48) is given by 

X(z) _ z - 3 _ k\ k 2 k 2 

~z~ ~ = z + 0.1 + z-0.4 + z - 0.7’ 


The partial fraction coefficients are calculated using the Heaviside formula: 


k i 


ki 


(z + 0.1) 
(z - 0.4) 


z — 3 

(z + 0.1)(z-0.4)(z-0.7) J z= _ 0 , 
z — 3 

(z + 0.1)(z — 0.4)(z — 0.7) J , =04 = 


31 


4 ’ 


52 

~3~’ 


and 


h = 


{z - 0.7)- 


z — 3 


(z + 0.1)(z-0.4)(z-0.7) 
The partial fraction expansion is given by 
X(z) 


31 


1 


52 


1 


or 


X(z) = 


4 (z + 0.1) 3 (z — 0.4) 

31 z 52 z 


4 (z + 0.1) 3 (z — 0.4) 


Jz=0.7 


115 

~ 12 ' 


115 1 

" 1 2 (z- 0.7) 

115 z 
~12 (z — 0.7) 


Assuming a right-sided sequence, the inverse z-transform x[k\ of the X(z) is 
given by 


x[k] = 


31 

~4 


(-0.1/ 



115 

~\2 


(0.7/ 


u [A] . 


Example D.10 

Using Eq. (D.46) for the partial fraction expansion, calculate the inverse z- 
transform of the following function: 


X(z) = 


z 2 - 3 z 

z 3 -z 2 + 0. 17z + 0.028' 
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Solution 

The transform X(z.) is expressed in the following form: 

z ~ l - 3z~ 2 

X(z) = 


(D.49) 


1 -z” 1 +0.17z- 2 + 0.028z- 3 ’ 
which has poles at z = —0.1, 0.4, and 0.7. The partial fraction expansion of 
Eq. (D.49) is given by 

z~ 1 — 3 z~ 2 

X(z) = 


1 -z" 1 +0.17z- 2 + 0.028Z" 3 
k\ kz kz, 


1+O.lz- 1 1 — 0.4z _1 1 — 0.7z _1 

The partial fraction coefficients are calculated using the Heaviside formula: 

31 


k i = 

ki = 
and 
k 3 = 


(1 + O.lz -1 )- 


z" 1 - 3z“ 2 


(1 + O.lz-'Xl - 0.4z _I )(l - 0.7z->) 


(1 -0.4z-')- 


r 1 - 3z- 2 


(1 + O.lz-'Xl - 0.4z _I )(l - 0.7z->) 


r ^-10 


z-!=l0/4 


4 ’ 


(1 -0.7z _1 ) 


,-t 


3z 


(1 + O.lz-'Xl - 0.4z _1 )(l - 0.7Z" 1 ). 


J z -i = 10/7 


52 


115 

~L2' 


The partial fraction expansion is given by 

31 ki 52 k 2 


X(z)= — 


115 


4 (1 + O.lz" 1 ) 3(1— 0.4z _1 ) 12(1— 0.7z _1 ) 

Assuming a right-sided sequence, the inverse z-transform v [k ] of the X(z) is 
given by 


x [ k ] = 


31 , 52 , 115 , 

(-0.1)* + — (0.4)* (0.7)* 

4 3 12 


u[k ] . 


Appendix E Introduction to Matl a b 


E.1 Introduction 


Matlab, an abbreviation for the term “MATrix LABoratory,” is a powerful 
computing environment for numerical calculations and multidimensional visu- 
alization. It has become a de facto industry standard for developing engineering 
applications for several reasons. First, Matlab reduces programming to data 
processing abstraction. Instead of becoming bogged down with the intrinsic 
details of programming, as required with other high-level languages, it allows 
the user to focus on the theoretical concepts. Developing code in Matlab 
takes a fraction of the time necessary with other programming languages. Sec- 
ondly, it provides a rich collection of library functions, referred to as toolboxes, 
in virtually every field of engineering. The user can access the library functions 
to build the required application. Thirdly, it supports multidimensional visual- 
ization that allows experimental data to be rendered graphically in a compre- 
hensible format. 

In this appendix we provide a brief introduction to Matlab . Our intention 
is to introduce the basic capabilities of Matlab so that the reader can start 
working on the problems contained in this text. In the following discussion, 
Matlab commands and results are shown in “Courier” font with the com- 
mands preceded by the >> prompt. Results returned by Matlab in response 
to the typed commands are also shown in the “Courier” font but are not 
preceded by the >> prompt. 


Starting a Matlab session 

Matlab is available on a variety of computing platforms. On an IBM com- 
patible PC, a Matlab session can be initiated by selecting the Matlab 
program or double clicking on its icon. In an X- window system, Matlab 
is invoked by typing the complete path to the executable file of Matlab at 
the shell prompt. Before using Matlab, it is recommended that you cre- 
ate a subdirectory named (matlab) (all lower case letters for case-sensitive 
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operating systems) in your home directory. Any file placed in this subdirectory 
can be accessed from within the M A TLA B environment without specifying the 
complete path of the file. 

Matlab includes a comprehensive combination of demos to illustrate the 
offered features and capabilities to its users. In order to explore the demo, just 
type demo at the command line of the Matlab environment indicated by the 
>> prompt: 

>> demo 

This will open the Matlab demo window. Follow the interactive options by 
clicking on the features that interest you. In most cases, the Matlab code 
used to generate the demo is also included for illustration. 


Help in Matlab 

Matlab provides a useful built-in help facility. You can access help either 
from the command line or by clicking on the graphical “Help” menu. On the 
command line, the format for obtaining help on a particular Matlab function 
is to type help followed by the name of the function. For example, to learn 
more about the plot function, type the following instruction in the Matlab 
command window: 

>> help plot 

If the name of the function is not known beforehand, you can use the lookf or 
command followed by a keyword that identifies the function being searched, 
to enlist the available Matlab functions with the specified keyword. For 
example, all Matlab functions with the keyword “Fourier” can be listed by 
typing the following command: 

>> lookfor Fourier 

On execution of the above command, Matlab returns the following list, 
specifying the names of the functions and a brief comment on their capabilities: 

FFT Discrete Fourier transform. 

FFT2 Two-dimensional discrete Fourier Transform. 

FFTN N-dimensional discrete Fourier Transform. 

IFFT Inverse discrete Fourier transform. 

IFFT2 Two-dimensional inverse discrete Fourier trans- 
form. 

I FFTN N-dimensional inverse discrete Fourier transform. 
XFOURIER Graphics demo of Fourier series expansion. 
DFTMTX Discrete Fourier transform matrix. 
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E.2 Entering data into Matlab 


Data can be entered in the Matlab as a scalar quantity, a row or column vector, 
and a multidimensional array. In each case, both real and complex numbers can 
be entered. As required in other high-level languages, there is no need to declare 
the type of a variable before assigning data to it. For example, variable a can 
be assigned the value (6 + j8) by typing the following command: 

>> a = 6 + j*8 

On the execution of the above command, Matlab returns the following 
answer: 

a = 6.0000 + 8 . OOOOi 

In the above command, we did not allocate any value to j, yet Matlab 
recognized it as a complex operator with value j 2 = 1 . There is a whole range 
of special words that are used by Matlab either as the name of functions or 
variables. These include pi, i, j , Inf, NaN, sin, cos, tan, exp, and rem. 
Type help elfun to list the names that are used by Matlab to specify the 
built-in functions and variables. The value of any of these special words can be 
changed by assigning a new value to it. For example, 

» sin = 1 

allocates the value of 1 to the variable sin. The Matlab definition of 
the trigonometric sine is overwritten by our command. To check the cur- 
rent status of the runtime environment of Matlab, type whos at the 
prompt: 

» whos 


Matlab returns the following answer: 


Name 

Size 

Bytes 

Class 


a 

lxl 

16 

double 

array (complex) 

sin 

lxl 

8 

double 

array 


Grand total is 2 elements using 24 bytes 

Alternatively, the command who can also be used to list the name of defined 
variables in the Matlab runtime environment. The command who does not 
provide additional details such as the size and class of each variable. In the 
preceding discussions, we overwrote the sin function and allocated a value of 
1 to it. Consequently, we cannot access the Matlab built-in function sin 
to evaluate the sine of an angle. To clear our definition of sin, we can use the 
following command: 


» clear sin 
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The original definition of sin is restored in the M ATL AB environment. Typing 
>> sin(pi/6) 

calls up the built-in sin function with jt/ 6 as the input argument. Recall 
that the variable pi is a built-in variable that has been assigned the value 
of 3.141 596 25. Matlab returns 

ans = 

0.5000 

after execution of the sin command. For additional information on the sin 
function, type help sin. To allocate the returned value of sin (pi/6) to 
variable x, for example, type 

» x = sin (pi/6) 

which returns 


X = 

0.5000 


In the above examples, Matlab displays the result of each instruction. The 
display can be suppressed by inserting a semicolon at the end of each instruction. 
For example, the command 

>> x = sin (pi/6 ) ; 

initializes x = 0.5000 without displaying the end result. 

Most common arithmetic operations are available in Matlab. These 
include + (add), — (subtract), * (multiply), / (divide), A (power), .* (array 
multiplication), and ./ (array division). For complex numbers, in addition to 
the aforementioned operators, Matlab provides a collection of library func- 
tions that can be used to perform more complex operations. These are illustrated 
through the following example, where a brief explanation of each instruction is 
included as a comment. In M A T L A B , the segment of line after the % sign on the 
same line are treated as comments and ignored during execution. The returned 
value is enclosed in parentheses and is also included with the explanation. 


» x = 2.3 - 4 . 7 * i ; 


>> x_magn 
>> x_phas 
>> x_real 
>> x_imag 
>> x_conj 


abs (x) ; 
angle (x) ; 
real (x) ; 
imag ( x ) ; 
conj (x) ; 


% Initializes x as a complex 
% variable. 

% magnitude of x, (5.2326) 

% phase of x in radians/s, (1.1157) 
% Real component of x, (2.3) 

% Imaginary component of x, (-4.7) 

% Complex conjugate of x, 

% (2.3 + 4 . 7i ) 
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Matlab also provides a set of functions for decimal numbers. If applied to 
integers, these functions do not make any changes. On the other hand, if these 
functions are applied to complex numbers, each operation is performed individ- 
ually on the real and imaginary component. Below we provide a selected list. 


>> 

x = 2.3 - 4 . 7 * i ; 

% 

>> 

x_round = round (x); 

% 

>> 

x_fix = fix(x) 

% 

>> 

x_floor = floor (x) 

% 



% 

>> 

x_ceil = ceil (x) 

% 



% 


Initializes x as a complex 
% variable 
rounds to nearest 
% integer, (2 - 5 i > 
rounds to nearest integer 
% towards zero, (2 - 4 i ) 
rounds down (towards negative 
infinity), (2 - 5i) 
rounds up (towards positive 
infinity) (3 - 4i) 


We now consider initialization of multidimensional arrays through a series of 
examples. 


Example E.l 

Consider the two row vectors 

/ = [ 1, 4, -2, (3 — 2i) ] 

and 

S = [-3, (5 + 7i), 6, 2], 


Perform the following mathematical operations in Matlab on vectors / and 

g- 


(i) 

(ii) 

(iii) 

(iv) 

(v) 


addition, r 1 = / + g ; 
dot product, r2 — f ■ g; 

1 A 

mean, r 3 = - } 

^ k= 1 


1 \ , 0 

average energy, r4 = - ^ |/(k)| 2 ; 

4 k=\ 

[ 4 ' 

variance, r5 = - | f(k) — r 3 1 2 , where r 3 is defined in (iii). 


k=\ 


Solution 

The Matlab code to solve part (i) is given below with comments following 
the % sign: 
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% initialize f 
% initialize g 

% Calculate the sum of f and g 
% The result is displayed due 
% to the absence of a 
% semicolon at the end of the 
% instruction 

results in the following value for rl: 
rl = 

-2.0000 9. 0000 + 7. OOOOi 4.0000 5 . 0000-2 . OOOOi 

which can be confirmed by direct addition of vectors / and g . 

(ii) To compute part (ii), we use the Matlab function dot as follows: 

>> r2 = dot(f,g) % dot returns dot product btw f and g 

which returns 
r2 = 

11. 0000 + 32. OOOOi 

An alternative approach to compute the dot product is to multiply the row vector 
f by the conjugate transpose of g. The transpose is needed to make the two 
vectors conformable for multiplication. You may verify that the instruction 

>> r2 = g*f'; % alternative expression for calculating 

% the dot product. Operator ' denotes 
% complex-conjugate transpose 

returns the same value as above. 

(iii) The instruction for part (iii) is as follows: 

>> r3 = sum(f ) /length(f ) % sum(f) adds all row entries 

% of vector f length (f) 

% returns no. of entries in f 

which returns 

r3 = 

1.5000 - 0 . 5000i 

(iv) The instruction for part (iv) is as follows: 

>> r4 = sum( f . *conj ( f) ) /length ( f ) 

% Operation f.*g does an element by 
% element multiplication of vectors f 
% and g. Operation conj(f) takes complex 
% conjugate of each entry in f 


» f = [14-2 3-2*i] ; 
» g = [-3 5 + 7 *i 6 2]; 
>> rl = f + g 
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which returns 

r4 = 

8.5000 

(v) To compute part (v), we can modify the code in part (iv) by preceding it 
with the following instruction: 

» f_zero_mean = f - mean(f) ;% mean(f) computes the 

% average value of f 
>> r5 = sum ( f_zero_mean . *conj ( f_zero_mean) ) /length 
( f _zero_mean) 

which returns 

r5 = 

6 

As a final note to our introduction on vectors, the second element of vector f 
can be accessed by the instruction 

» f(2) 

which returns 

ans = 

4 

A range of elements within a vector can be accessed by specifying the integer 
index numbers of the elements. To access elements 1 and 2 of row vector f , for 
example, we can type the instruction 

» f ( 1 : 1 : 2 ) ; 

Similarly, the odd number elements in f can be accessed by the instruction 
» x = f ( 1 : 2 : length ( f) ) ; 

where we have assigned the returned value to a new variable x. Code 
1:2:1 ength ( f ) is referred to as a range-generating statement that generates 
a row vector. The first element of the row vector is specified by the left-most 
number (1 in our example). The next element in the row vector is obtained by 
adding the middle element (2 in our example) to the first element and proceed- 
ing all the way till the limit (length ( f ) ) is reached. The middle element (2 in 
our example) specifies the increment, while the third element ( length ( f ) ) 
is the ending index. If the increment is missing, Matlab assigns a default 
value of 1 to it. As another example, the range-generating statement 1:11 pro- 
duces the row vector [1234567891011]. Further, the start- 
ing index, increment, or ending index can also be real-valued numbers. The 
range-generating statement [0.1:0. 1:0. 9] produces the row vector [0.1 
0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9]. 
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Example E.2 

Initialize the following matrix: 



1 0 

3 9 


and take the pseudo-inverse of A, defined as A + = ( A T A ) 1 A 1 with T denoting 
the conjugate transpose operation. 

Solution 

The following Matlab code initializes matrix A: 

» A = [24-1 0;5 2 3 9]; % The semicolon inside square 


An alternative but longer set of instructions for the initialization of A is as 
follows: 

» A (1,1) =2; A ( 1 , 2 ) =4 ; A(l,3)=-1; A(l,4)=0; 

>> A ( 2 , 1 ) =5 ; A ( 2 , 2 ) =2 ; A(2,3)=-3; A(2,4)=9; 

To calculate the pseudo-inverse of A, the following instruction may be used: 

>> Ainverse = inv (A' *A) *A' ; % Function inv calculates 


which returns a warning that the matrix is singular. From linear algebra, we 
know that the inverse of a matrix only exits if it is non-singular, hence the 
pseudo-inverse does not exist for the above choice of A. 

Example E.3 

Initialize the following discrete-time function: 


Solution 

As in other high-level languages, we can use a for statement to initialize the 
function /. The code is given by 


% parenthesis separates 
% adjacent rows of a matrix 


% inverse of a matrix 
% while ' denotes conjugate 
% transpose 



for 0 < k < 30. 
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for k = 0:1:30, 

f(k+l) = 2*cos (pi/15*k) ; % In Matlab, the index of a 

% vector or a matrix must 
end % not be zero. 


In Matlab , the index of a vector or matrix cannot be zero. Therefore, we use 
two row vectors k and f to store the DT function. The row vector k specifies 
the time indices at which function f is evaluated, while f contains the value 
of the DT function at the corresponding time index stored in k. The above 
initialization can also be performed in Matlab more quickly and in a much 
more compact way. 

clear % user-defined variables are cleared 

k=0:30; %kisa row vector of dimensions 1x30 

f = 2*cos(5*k) % f has the same dimensions as k 

returns the following answer: 

f = 

Columns 1 through 7 

2.0000 0.5673 -1.6781 -1.5194 0.8162 1.9824 0.3085 
Columns 8 through 14 

-1.8074 -1.3339 1.0506 1.9299 0.0443 -1.9048 -1.1249 
Columns 15 through 21 

1.2666 1.8435 -0.2208 -1.9688 -0.8961 1.4603 1.7246 
Columns 22 through 28 

-0.4819 -1.9980 -0.6516 1.6284 1.5754 -0.7346 -1.9922 
Columns 29 through 31 
-0.3956 1.7677 1.3985 

In terms of execution time, implementation 2 is more efficient than the first 
implementation. Since Matlab is an interpretive language, loops take a long 
time to be executed. An efficient Matlab code avoids loops and, if possible, 
replaces them with matrix or vector multiplications. 

Example E.4 

Initialize the following DT function: 

g[k] = f[k] for 0<k<6. 


Solution 

In the above example, it has been assumed that the matrix / has been initialized 
as per Example E.3. The following Matlab code will initialize row vector 

8 - 


» g = f (1:7) ; 
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If missing, a default value of 1 is assumed as the increment in the range- 
generating statement (1:7). Therefore, g ( 1 : 7 ) is equivalent to g ( 1 : 1 : 7 ) . 


E.3 Control statements 


Matlab supports several other loop statements (while, switch, etc.) as 
well as the i f - e 1 s e statement. In functionality, these statements are similar to 
their counterparts in C but the syntax is slightly different. In the following, we 
provide examples for some of the loop and conditional statements by providing 
analogy with the C code. Readers who are unfamiliar with C can skip the C 
instructions and study the explanatory comments that follow. 

Example E.5 

Consider the following set of instructions in C: 

int X [ 2 ] [2] ={ {2, 5}, {4, 6} }; /* 

int Y [2 ] [2 ] ={ {1, 5}, {6, -2} }; /* 

int Z [2] [2] ; 

for (m = 1; m <= 2; m++) { 

Z [m] [n] = X [m] [n] + Y [m] [n] ,- 

/* 

} 

Write down the equivalent Matlab code for the above instructions. Can the 
Matlab code be simplified? 

Solution 

Implementation 1 Following a step-by-step conversion of the C code into 
Matlab yields 

>> X = [2 5; 46] % X is initialized 

>> Y = [1 5; 6 -2] % Y is initialized 

>> for m = 1:2, 

for n = 1:2, 

Z(m,n) = X (m, n) +Y (m, n) ,- 
end 
end 

Implementation 2 The for loops in Matlab can be replaced by the while 
statement as follows: 

>> X = [2 5; 46] % X is initialized 

>> Y = [1 5; 6 -2] % Y is initialized 

>> m = 1 ; 

>> while (m < 3 ) , 


initialize matrix X */ 
initialize matrix Y */ 
/* declare Z */ 

Z = X + Y * / 
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n = 1 ; 

while (n < 3 ) , 

Z(m,n) = X (m, n) +Y (m, n) ; 
n = n + 1 ; 
end 

m = m + 1 ; 

end 


Implementations We can avoid the two for or while loops by performing 
a direct sum of matrices X and Y as follows: 

>> X = [2 5; 46] % X is initialized 

>> Y = [1 5; 6 -2] % Y is initialized 

» Z = X + Y; 

Compared with the first two implementations, the third implementation is 
cleaner and faster. 


Example E.6 

Consider the following set of instructions in C: 


int a 

= 15; 

/* 

initialize 

scalar 

a 

int x; 


/* 

declare x 

*/ 




if (a 

> 0) 







x = 

5; 

/* 

initialize 

X 

to 

5 

if 

else 








x = 

100; 

/* 

initialize 

X 

to 

5 

if 


Write down the equivalent Matlab code. 


*/ 


a 


a 


> 0 */ 

<= 0 */ 


Solution 

Following a step-by-step conversion, we obtain the following equivalent set of 
instructions in Matlab : 

» a = 15; 

» if a > 0, 
x = 5; 
else, 

x = 100 
end 

While using the conditional statements, relational operators such as equal to, 
not equal to, or less than are generally required in the code. Matlab provides 
six basic relational operators which are defined in Table E. 1 . 
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Table E.l. Relational operations available in 

Matlab 


Relational operator 

Definition 

< 

less than 

> 

greater than 

= = 

equal to 

~ = 

not equal to 

< = 

less than or equal to 

> = 

greater than or equal to 


E.4 Elementary matrix operations 


Matlab provides several built-in functions to manipulate matrices. In the 
following, we provide a brief description of some of the important matrix oper- 
ations. Consider the instruction 


>> f = exp ( 0 . 05* [1 : 30] ) ; % Initialize row vector f 
which initializes the row vector f according to the following definition: 
f[k] = e°- 05k for 1 < k < 30. 

The following Matlab instructions provide examples of basic arithmetic 
operations performed on a row or column vector. Comments against each 
instruction provide a brief description of the instruction, with the value returned 
by Matlab enclosed in parenthesis: 


>> f_max = max(f) ; 

>> f_min = min(f) ; 

>> f_sum = sum(f) ; 

>> f_prod = prod(f); 


% Maximum value in f (4.4817) 

% Minimum value in f (1.0513) 

% Sum of all entries in f (71.3891) 
% Product of entries in 
f ( 1 . 2 513e+10 ) 


>> f_mean = mean(f); % Mean of entries in f (2.3796) 

>> f_var = var(f); % Variance of entries in f (1.0578) 

>> f_size = size(f); % Dimensions of f ([1 30]) 

>> f_length = length(f); % Length of f (30) 

>> fprintf ( ' \nThe min value of all matrix elements = 

%f\n' , f_min) ; % Prints the variable f_min 


The fprintf instruction at the end of the code is used to print the value of 
the variable f _min onto the screen. It returns 


The min value of all matrix elements = 1.051300 

The aforementioned instructions can alternatively be used for matrices and 
higher dimensional arrays. The syntax stays the same, but the result may be 
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different. For matrices, for example, the specified operation is performed on 
each column of the matrix and a row vector is returned as the answer. For 
example, consider the matrix F initialized by the following instruction: 

» F = magic(5); % magic (N) returns an (N x N) matrix 

% with entries between 1 through 
% N a 2 having equal row, column, and 
% diagonal sums 

For matrix F, the values indicated in the comments are returned: 


>> F_max = max(F); 

>> F_min = min(F); 

» F_sum = sum ( F ) ; 

» F_prod = prod(F); 


» F_mean = mean ( F ) ; 
» F_var = var ( F ) ; 


» F_size = size(F); 
» F_length 

= length (F); 


% Maximum value along each column 
% [23 24 25 21 22] 

% Minimum value along each column 
% [ 45123 ] 

% Sum of entries along each column 
% [65 65 65 65 65] 

% Product of entries along each 
% column 

% [172040 155520 43225 94080 142560] 
% Mean of entries along each column 
% [13 13 13 13 13] 

% Variance of entries along each 
% column 

% [52.5 65.0 90.0 65.0 52.5] 

% Dimensions of F; [5 5] 

% Returns number of rows in F (5) 


For completeness, we also include a list of some basic matrix operations, some 
of which were introduced in Section E. 1 : 


>> 

X = [2 

5; 

4 6]; 

>> 

Y = [1 

5; 

6 -2] 

>> 

Zsum = 

X + Y; 

>> 

Zdif = 

X - Y; 


» Zprod = X*Y; 


% Initailize (2x2) matrix X 
% Initailize (2x2) matrix Y 
% Adds matrices of equal dimensions . 

% Returns [3 10; 10 4] 

% Subtracts matrices of equal 
% dimensions ; 

% Returns [1 0; -2 8] 

% Multiplies matrices conformable for 
% multiplication; Returns 
% [32 0; 40 8] . 
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>> Ztran = X' ; 

>> Zinv = inv(X); 

>> Zarraymul = X.*Y; 
>> Zarraydiv = X./Y; 
>> Zpowerl = X. A 2; 

» Zpower2 = X. A Y; 


% Calculates transpose of X 
% Returns [2 4; 5 6] 

% Inverts X 

% Returns [-0.75 0.62; 0.50 -0.25] 

% Element by element multiplication 
% Returns [2 25; 24 -12] 

% Element by element division 
% Returns [2 1; 0.6667 -3] 

% Each element is raised to power 
% by 2 

% Returns [4 25; 26 36] 

% Each element in X is raised to 
% power by its corresponding 
% element in Y 

% Returns [2 3125; 4096 0.028] 


E.5 Plotting functions 


Matlab supports multidimensional visualization that allows experimental 
data to be rendered graphically in a comprehensible format. In this section, we 
will focus on 2D plots for continuous-time and discrete-time variables. Readers 
should check the demo for more advanced graphics including 3D plots. 

Example E.7 

Plot the following function: 

f[k] = 2cos(0.5 k) 

as a function of k for the range —20 < k < 20. 


Solution 

The following set of Matlab instructions will generate and plot the function: 


» k = -20:20; 

» f = 2 *cos ( 0 . 5*k) ; 

>> figure (1) ; 

>> plot ( k, f ) ; grid on; 

>> xlabel ( ' k ' ) ; 

>> ylabel ( ' f [k] ' ) ; 

axis ( [-25 25 -3 3] ) 


% Initializes k as a (lx 41) 

% row vector 

% Initializes f as cos (0.5k) 

% selects figure 1 where plot 
% is drawn 

% CT plot of f (ordinate) 

% versus k (abscissa) 

% Grid is turned on 
% Sets label of X-axis to k 
% Sets label of Y-axis to f[k] 
% Plot is viewed in the range 
% given by 


>> 
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(a) 


(b) 


Fig. E.I. Plots of 

f[k] = 2 cos(0.5 k) versus k in 

the range -20 <k< 20. » p rint -dtiff plot, tiff 

(a) CT plot; (b) stem DT plot. 


% [x-min x-max y-min y-max] 
% Saves figure in the file 
% "plot. tiff" in 
% the TIFF format 


These instructions produce a continuous plot cosine wave, as shown in 
Fig. E.l. It is also possible to construct a discrete-time plot using the stem 
function: 

>> figure (2) 

>> stem (k, f filled' ) ; % DT plot; option 'filled' 

% fills the circles at the 
% top of vertical bars 

>> xlabel('k'); % Sets label of X-axis to k 

>> ylabel ( ' f [k] ' ) ; % Sets label of Y-axis to f[k] 

» axis ( [-25 25 -3 3] ) 

>> print -dtiff plot2.tiff 


Both plot and stem functions have a variety of options available, which may 
be selected to change the appearance of the figures. The reader is encouraged 
to explore these options by seeking help on these functions in Matlab. In 
addition, there are several other 2D graphical functions in Matlab. These 
include semilogx, semilogy, loglog, bar, hist, polar, stairs, 
rose, errorbar, compass, and pie. 
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(a) 


(b) 


Fig. E.2. Multiple plots sketched 
in the same window for Example 
E.8. 



(c) (d) 


Plotting multiple graphs in one figure 

Matlab provides the function subplot to sketch multiple graphs in one 
figure. We demonstrate the application of the subplot function through an exam- 
ple. 


Example E.8 

Plot the following functions over the specified range in one figure: 


(a) fi[k] = sin(0.1jr£) for — 5 < k < 5; 

(b) f 2 [k] = 2~ k for -7 < k < 7; 

1 (0 < k < 4) 

3 (5 < k < 9) ; 

k (0 < k < 5) 

0 (6 < k < 9). 


(c) f 3 [k] = 

(d) Mk] = 


Solution 

The following set of Matlab instructions plots the four functions illustrated 
in Fig. E.2. 
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>> 

>> 

>> 

>> 

>> 

>> 


>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

>> 

» 


% Part (a) 
figure ( 5 ) 
elf 

k = [-5:5] ; 

fl = sin ( 0 . l*pi*k) ; 

subplot (2,2,1) ; 


stem (k, f 1 , ' filled' ) ; 
grid on; 
xlabel ( 'k' ) ; 
ylabel ( ' f 1 [k] ') 

% Part (b) 
k = [-7:7] ; 

f2 = 2. A (-k) ; 
subplot (2,2,2) ; 
stem(k, f2 , ' filled' ) ; 
grid on; 
xlabel ( ' k ' ) ; 
ylabel ( ' f 2 [k] ' ) ; 

% Part (c) 
k = [0:9]; 

f 3 = [1 11113333 
subplot (2,2,3) ; 
stem(k, f3 , ' filled' ) ; 

grid on; 
xlabel ( ' k ' ) ; 
ylabel ( ' f 3 [k] ' ) ; 

% Part (d) 
k = [0:9]; 
f 4 = [0123450000]; 
subplot (2,2,4) ; 
stem(k,f4, 'filled'); 
grid; 

xlabel ( 'k' ) ; 

ylabel ('f4[k] ') ; 

print -dtiff plot. tiff; 


% Select figure 5 for plots 
% Clear figure 5 
% k = [-5-4 . . .0 ...45] 

% Calculate function fl 
% Divides fig 5 into (m = 2) 
% vertical and (n = 2) 

% horizontal sub-figures. 

% The last argument (p = 1) 
% accesses sub-figures 
% ( 1 <= p <= m*n) . 

% DT plot of fl versus k 
% Label of X-axis 
% Label of Y-axis 

% k overwritten to 
% [-7 -6 . . .0 . . .6 7] 

% Calculate function f2 
% Select p = 2 sub-figure 

% DT plot of f2 versus k 
% Label of X-axis 
% Label of Y-axis 


% DT plot of f3 versus k 
% Label of X-axis 
% Label of Y-axis 

% Calculate function f4 
% Select p = 4 sub-figure 

% DT plot of f2 versus k 
% Label of X-axis 
% Label of Y-axis 
% Save the figure as a 
% TIFF file 


% k overwritten to 
[0 1 . . .8 9] 

3]; % Calculate function f3 
% Select p = 3 sub-figure 


>> 
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E.6 Creating Mat lab functions 


In the preceding examples, we have used Matlab in an interactive mode 
with each instruction individually typed at the command prompt. Matlab 
allows for the creation of M-files, where instructions can be stored in a file. 
An M-file can be of two types, called scripts and functions. A script is a list of 
Matlab instructions that are saved in file with a . m extension. The script 
file can access the variables defined in the Matlab workspace. Likewise, 
all variables declared in the script are accessible to the workspace. For exam- 
ple, the instructions to solve part (a) of Example E.8 can be stored in a file 
myf irstplot .mas follows: 


% Content of script 
% Part (a) 
figure (5) 
elf 

k = [-5:5] ; 

fl = sin ( 0 . l*pi*k) ; 

subplot (2,2,1) ; 


myf irstplot .m 

% Select figure 5 for plots 
% Clear figure 5 
% k = [-5-4 . . .0 ...45] 

% Calculate function fl 
% Divides fig 5 into (m = 2) vertical 
% and (n = 2) horizontal sub-figures 
% The last argument (p = 1) accesses 
% sub-figures (1 <= p <= m*n) 


stem(k, fl, ' filled' ) ; 

grid on; 
xlabel ('k'); 
ylabel ( ' f 1 [k] ') 


% DT plot of fl versus k 
% Label of X-axis 
% Label of Y-axis 


To execute my f ir s tpl o t . m, simply type the name of the M-file (myf irst- 
plot in this case) at the command prompt. By executing the function whos, 
you can determine that all variables defined in myf irstplot .m are part of 
the Matlab workspace. 

A function in Matlab is a special type of script file that can accept input 
arguments and return output arguments. Variables declared within a function are 
local to the function. Likewise, none of the variables defined in the Matlab 
working environment are accessible by the function unless these variables are 
explicitly passed as an input argument to the function. A function file must 
follow a specific format. The first line defines the function by specifying a 
name for the function and indicates the number of input and output arguments. 
Immediately following the definition, lines that begin with a comment symbol 
(%) are printed when help is requested on the function. As an example, we 
modify script my firstplot.m into a function in the following . 
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function [fl] = myfirstplot (k) 

% USAGE: [fl] = myfirstplot (k) 

% Plots fl = sin ( 0 . l*pi*k) as a function of k in subplot 
% (2,2,1) where k = row vector containing the indices 
% where fl is to be defined fl is the output row vector 


figure ( 5 ) 
elf 

fl = sin ( 0 . l*pi*k) ; 
subplot (2,2,1) ; 


% Select figure 5 for plots 
% Clear figure 5 
% Calculate function fl 
% Divides fig 5 into (m = 2) vertical 
% and (n = 2) horizontal sub-figures 
% The last argument (p = 1) accesses 
% sub-figures. (1 <= p <= m*n) 


stem (k, f 1 , 'filled' ) ; 

grid on; 
xlabel ( 'k' ) ; 
ylabel ( ' fl [k] ' ) 


% DT plot of fl versus k 
% Label of X-axis 
% Label of Y-axis 


end 


Once a function has been created, it must be saved in a ble whose name is 
same as the debited name of the function. In our example, the aforementioned 
function must be saved in a ble myfirstplot .m. The calling format for a 
function is the same as one would use to access a Matlab built-in function. 
To access myfirstplot, the following instructions must be typed at the 
Matlab prompt: 

>> m = [-5:5]; % Define the input argument 

>> [y] = myfirstplot (m) ; % Output value is returned to y 

% with subplot plotted in 
% figure 5 


E.7 Summary 


In this appendix, a working introduction to Matlab is provided. The intent 
is to introduce the basic capabilities of Matlab to the reader. Matlab 
supports hundreds of built-in functions from linear algebra, numerical analysis, 
polynomial algebra, and numerical optimization. These built-in functions are 
supported in both the student and full version of Matlab , and do not require 
any toolboxes. A list of built-in functions is available on the Mathworks website 
(www.mathworks.com). Readers are encouraged to visit the website and explore 
Matlab in more detail. 


Appendix F About the CD 


This book is accompanied by a CD that includes material for supplementary 
reading, M ATLAB code used in the text, and data used in different simulations. 
The organization of the CD is shown in Table F. 1 . 

In Table F.l, we have assumed that the CD drive is mapped to the shortcut 
“CD.” Check the appropriate shortcut to the CD drive on your computer. For 
example, if the CD drive is mapped to the shortcut “F,” replace “CD” in the 
aforementioned paths to the folders with “F” such that the path to the interactive 
programs is specified by F:\InteractEnv. The other two folders can be found in a 
similar way. In the following we provide additional information on each folder. 


F.l Interactive environment 


The “InteractEnv” folder contains three interactive learning objects used to 
explain the operations of convolution integral, convolution sum, and digital 
filtering. While the first two learning objects developed to explain convolution 
integral and sum are based on Macromedia Flash, the third learning object uses 
a graphical interface environment based on Mat LAB . 


F.1.1 Convolution 


Convolution is an important signal processing operation, which is extensively 
used to compute the output of linear time-invariant systems. The graphical 
approach to solve the convolution integral in the CT domain was presented in 
Section 3.5. Likewise, the steps involved in computing the convolution sum in 
the DT domain were explained in Section 10.5. To help understand the two 
convolution operations, the CD includes two Shockwave Flash animations, one 
each for the convolution integral and convolution sum. 

The learning object for the convolution integral convolves the following CT 
signal: 


x(t) = u(t + 0.5) — u(t — 1) with h(t) = u(t + 0.5) — u{t + 1) 
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Table F.T. Organization of the CD 


Folder Comments 

CD:\ InteractEnv contains interactive programs explaining important 

concepts such as the convolution integral, the 
convolution sum, and digital filtering 

CD:\Data contains selected audio clips and images used in MATLAB 

simulations 

CD:\ MATLAB Codes contains MATLAB functions used in the text 


Table F.2. Values of the sequence y[k\ 


k - 5 - 4 - 3 - 2-1012 

y\k\ 8 12 14 15 15 7 3 1 


and describes the graphical approach to derive the output of the LTIC system. By 
analytical computation, it is straightforward to derive the following expression 
for the output: 


y(t) = 


t+ 1 — 1 < f < 0.5 

—t + 2 0.5 < t < 2 

0 otherwise. 


The learning object for the convolution sum uses the following DT sequences: 
x[k] = u[k + 2] - u[k - 3] with h[k] = 2~ k (u[k + 3] - u[k - 1]) 


and describes the graphical approach to derive the output of the LTID system. 
All non-zero values of the output sequence y[k] are specified in Table F.2. 
In order to run the two animations, you should open a web browser, such as 
Netscape or Internet Explorer (IE), with the Flash Player incorporated within 
the browser. If the Flash Player is not incorporated, it can be downloaded and 
installed from http:/www.macro. media.com, which is the official website of 
Macromedia. In the following, we highlight the procedure for the convolution 
integral through a series of steps. 


Step 1 Open the internet browser (Netscape or IE) by selecting the program 
from the task bar. Within the browser, select the “File” option from the extreme 
top left menu and click on the “Open” option. This opens a dialog box, where 
you can provide the complete path to the convolution integral animation and 
choose a file. Browse to the convolution animation and select it. In our case, 
the path to the animation for the convolution integral is given by 

CD:\InteractEnv\convolution\ConvolutionIntegral.swf 

where CD specifies the drive name to the CD-ROM. After the execution of step 
1 , a frame similar to that in Fig. F. 1 would be displayed on the computer screen. 
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Fig. F.l. Initial Flash window for 
convolution integral. 



Step 2 The frame displayed in step 1 has three subwindows. The top subwindow 
on the left-hand side plots the figures graphically, while the top subwindow on 
the right displays different steps involved in computing the convolution integral. 
The step being executed is highlighted, with the explanation included in the 
bottom subwindow. To interact with the animation, three options are available. 
Clicking on the “previous step” option moves the animation back by one frame, 
showing the result of the previous step. Clicking on the “next step” moves the 
animation forward by one frame, while clicking on the “reset” option initializes 
the animation to the start. 

Step 3 Play the animation according to your speed and try to understand all 
operations performed to compute the result of the convolution integral. Once 
the animation has been completely played, a frame similar to that in Fig. F.2 
would appear on the computer screen. 

The procedure for running the convolution sum animation is identical to that 
of the convolution integral. Once this animation has been completely played, a 
frame similar to that in Fig. F.3 would appear on the computer screen. 


F.1.2 Digital audio filtering 

To explain digital filtering, the CD provides a set of M A T L A B programs used to 
create a digital audio filtering interactive environment (DAFIE). The programs 
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Fig. F.2. Final frame for the 
learning object explaining the 
convolution integral operation. 



are available in the following folder: 

CD : \InteractEnv\filter 

where CD specifies the drive name to the CD-ROM. DAFIE is a graphical user 
interface (GUI), which may be used to select an audio file, read the signal, 
and manipulate the signal in different ways. The following four functions are 
primarily used to create the interactive environment: 


daf ie . m 
localbutton.m 

designf ilter . m 

openf ile .m 


% main program for generating DAFIE 
% function that selects the operation 
% using local buttons 
% designs filters based on the specs 
% provided by the user 
% opens a dialog box to select an input 
% audio file 


The main program daf ie uses the built-in Matlab function uicontrol 
to create the user interface. When the main program daf ie is run, an inter- 
active window is created. A snapshot of the window is shown in Fig. F.4. The 
interactive window consists of three sub windows: Command, Comments, and 
Graphics. The Command subwindow controls the environment through a series 
of buttons. A brief description on the functionality of each button is as follows. 
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Fig. F.3. Final frame for the 
learning object explaining the 
convolution sum operation. 



Read File: Loads the input signal from a sound file stored in the wav 
format. 

Plot Signal: Plots the loaded signal in the Graphics window. 

Play Signal: Plays the audio signal. The user must have a sound card and 
speakers to hear the audio. 

Signal Spectrum: Computes the power spectrum of the audio signal and 
displays it in the Graphics subwindow. The power spectrum is calculated 
by parsing the audio signal in segments. Each segment has a length of 
1024 samples with an overlap of 512 in between the neighboring seg- 
ments. Section 17.2.3 explains the steps involved in computing the power 
spectrum of a signal. 

Design Filter: Designs a DT filter and displays the coefficients of the fil- 
ter. If the selected filter is of the FIR type, then the impulse response 
h [k] of the filter is plotted in the Graphics window. If the selected filter 
is of the HR type, then the coefficients of the numerator and denomi- 
nator of the transfer function of the filter are displayed using the stem 
plot. DAFIE provides the option of selecting one of the Bartlett, Ham- 
ming, Hanning, Blackman, or Kaiser windows in designing the FIR fil- 
ter with the number of taps limited to 201. For HR filters, the choices 
are limited to the Butterworth or Chebyshev type II filter with a stop- 
band attenuation of at least 50 dB and pass-band ripples limited to a 
maximum level of 2 dB. The number of taps is ignored for the HR 
filters. 
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Fig. F.4. The DAFIE environment 
for digital audio filtering. 


Graphics 

Window 


Commands 

Window 


Comments 

Window 



Freq Response: Calculates and plots the magnitude spectrum of the 
designed filter. The magnitude spectrum is displayed in the Graphics win- 
dow. 

Apply Filter: Filters the input signal and plots the resulting output signal as 
a function of time. 

Play Filt Signal: Plays the output (filtered) signal as audio. 

Filt Sig Spectrum: Computes the power spectrum of the output signal and 
displays it in the Graphics window. 

Save Output: Stores the output signal as audio in the file (output . wav) 
in the working directory. If you choose this command, ensure that you 
have write permission to the current working directory. 

Exit Dafie: Exits the DAFIE, ending the program. 


F.2 Data 


The Data folder in the CD contains two subfolders. These subfolders contain 
different audio clips and images used in the text. The audio clips are stored 
in the wav format with the .wav extension. The images are stored in the TIFF 
(also referred to as the TIF) format, where the image data is stored without any 
distortions. A list of the audio clips and images included in the CD is provided 
in the following. 

Audio clips (CD:\Data\audio) 

bell.wav % Audio sampled at 22.05 kHz and 

% quantized to 8 -bits 

test44k.wav % Audio sampled at 44.1 kHz and 
% quantized to 8 -bits 
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noisy_audiol.wav % Audio signal corrupted with 
% narrowband noise 

noisy_audio2.wav % Audio signal corrupted with 
% wideband noise 

Gray images (CD:\Data\image) 

{ayantika.tif, lena.tif, % Images used in this book 

rini.jpg, sanjukta.tif, 
train.jpg} 

{castle.jpg, eiffel.jpg, % Other images given for 

girl.jpg, sounio.jpg} % solving problems 

Note that images with tif/tiff extension include no distortion. On the other hand, 

images with jpg extension are compressed using JPEG codec. 

Color images (CD:\Data\image\color) 

{castle, eiffel, gardern, girl, % Selected color images 
lena, sanjukta, sounio, % in JPG/TIFF format 

stadium, train} 


F.3 Matlab codes 


The CD includes the Matlab codes used in various examples in the text. In 
the following, we provide a listing of the names of the functions arranged in 
terms of their inclusion in different chapters. 


Chapter 1 

Example_01_2 3 . m 
Example_01_2 4 . m 

Chapter 3 

Example_03_12 . m 
Example_03_13 . m 
my fund ,m 
myfunc2 ,m 


% plots several CT functions using 
% subplot and plot 
% plots several DT sequences using 
% subplot and stem 


% solves first order differential 
% equation 

% solves second order differential 
% equation 

% defines a first order differential 
% equation 

% computes vector of derivatives 
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Chapter 5 

bodeplot .m 
myctf t .m 
myinvctf t . m 
section_5_10_l .m 

Chapter 7 

Example_07_5 .m 
Example_03_7 .m 
Example_07_8 .m 
Example_03_9 .m 
Example_03_10 .m 
Example_07_ll .m 
Example_03_12 .m 

Chapter 8 

ImmuneSysteml .mdl 
ImmuneSystem2 .mdl 

Chapter 10 

Example_10_17 .m 
Example_10_18 .m 
Example_10_19 .m 


% plots BODE plot of a transfer 
% function in section 5.10.2 
% calculates CTFT of a function in 
% section 5.10.1 

% calculates inverse CTFT of a function 
% in section 5.10.1 
% calculates CTFT of a function in 
% section 5.10.1 


% calculates and plots frequency 
% response of Butterworth filter 
% calculates and plots frequency 
% response of Chebyshev I filter 
% calculates and plots frequency 
% response of Chebyshev II filter 
% calculates and plots frequency 
% response of elliptic filter 
% designs highpass filter and plots 
% frequency response 
% designs bandpass filter and plots 
% frequency response 
% designs bandstop filter and plots 
% frequency response 


% Simulink model for stable immune 
% system 

% Simulink model for unstable immune 
% system 


% calculates system output using direct 
% method in Example 10.17 
% calculates system output using direct 
% method in Example 10.18 
% calculates system output using conv 
% function in Example 10.19 
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Chapter 12 

Example_l 2 _6 .m 
Example_12_7 .m 

Example_12_8 .m 
Example_12_8 _N64 . m 
Example_12_9 .m 
Example_12_ll . m 
mydf t . m 
myf f t . m 
tf f t .m 

Chapter 13 

Examp 1 e_l 3 _2 0 . m 
Examp 1 e_l 3 _2 1 . m 
Examp 1 e_l 3 _2 2 . m 

Chapter 14 

sectionl4_9_l .m 
sectionl4_9_2 .m 

Chapter 15 

Example_15_9 .m 
Example_15_10 . m 


% calculates freq. charac. of decaying 
% exponential function using dft 

% calculates freq. charac. of two 
% complex exponential functions 
% using dft 

% calculates frequency characteristics 
% using N=32 

% calculates frequency characteristics 
% using N=64 

% calculates dft of a decaying 
% exponential function 

% calculates DTFT of an aperiodic 
% sequence 

% calculates dft using direct 
% calculation 

% calculates dft using radix-2 fft 
% method 

% test program to compare mydft and 
% myf ft functions 


% calculates partial fraction 
% coeffs of H (z) =B (z) /A (z) 

% calculates poles and zeros and plots 
% them in the z -plane 
% calculates transfer function of a 
% system from its poles and zeros 


% calculates the partial fraction 
% coefficients in section 14.9.1 
% calculates the zeros and poles of a 
% transfer function in section 14.9.2 


% designs lowpass FIR filter using 
% Hamming/Blackman windows 
% designs lowpass FIR filter using 
% Kaiser window 

% designs lowpass FIR filter using 
% Parks -McClellan algorithm 


Example_15_ll . m 


857 


F About the CD 


Chapter 16 

Example_16_2 . m 
Example_16_3 . m 
Example_16_4 . m 
Example_16_5 . m 

Example_16_6 . m 

Example_16_7 . m 

Chapter 17 

Example_17_2 . m 
Example_17_3 . m 

Example_17_4 . m 

Example_17_5 .m 
Example_17_8 .m 

Example_17_9 .m 

Example_17_10 .m 
Example_17_ll .m 
Example_17_12 .m 

Section_17_2_3 .m 

Section_17_2_5 .m 

Section_17_5_3 .m 

Example_E_7 . m 
Example_E_8 . m 


% converts a CT filter to DT using 
% impulse invariance method 
% converts a CT filter to DT using 
% impulse invariance method 
% converts a CT filter to DT using 
% bilinear transformation 
% designs highpass HR filter using 
% CT elliptic filter and bilinear 
% transform 

% designs bandpass IIR filter using 
% CT elliptic filter and bilinear 
% transform 

% designs bandstop IIR filter using 
% CT elliptic filter and bilinear 
% transform 

% calculates spectrogram of a DT signal 
% calculates power spectral density 
% using Welch method 

% filters (lowpass, bandpass, highpass) 

% an audio signal 

% bandstop filters an audio signal 
% calculates 2-D spectrum of a grating 
% image 

% spectral analysis and lowpass 
% filtering of an image 
% highpass filters an image 
% predictive coding of an image 
% JPEG compression of an image with 
% different quality factors 
% calculates power spectral density of 
% an audio signal 

% calculates power spectral density of 
% a music signal 

% reads and manipulates an image 

% plots a CT and a DT function 
% plots several functions in one figure 
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sliding tape method of, 436 
Corner (break) frequency, 332 
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iterative solution of, 423 
linear, 43 1 

z-transform solution of, 594-595 
Differential equation, 63, 64-67 
time-domain solution of, 106-1 11, 131—135 
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z-transform analysis of, 594-609 
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Distortionless transmission, 560 
Downsampling (decimation), 41 
DPCM, 769 
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Exponential Fourier series, 163-179 
Fast Fourier transform (FFT), 553-558 
radix-2 algorithm, 553-556 
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Feedback systems, 308 
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Filter realization 
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linear phase form, 573 
parallel form, 581 
transposed form, 573 
Filters, 322-367, 555-744 
allpass, 260, 304-305 
analog, see continuous-time filter 
bandpass, 322, 357-361, 557, 612-615, 737 
bandstop, 322-323, 361-364, 558, 

615-617, 738 

butterworth, 321, 328-338, 351, 720-730, 
733-735 
causal, 565, 592 
chebyshev, 321, 338-349, 351 
digital, 555 

elliptic, 321, 349-352, 716, 736-738 
FIR, 559 

frequency transformation in, 352-364 
group delay of, 561 

highpass, 321-322, 353-357, 556, 609-612, 
736 



862 


Index 


Filters ( cont .) 

ideal, 321-324, 556-558 
HR, 559 

linear phase, 562, 591 

lowpass, 321, 327-352, 556, 591-608 

non-ideal, 565 

phase delay of , 561 

realization, 570 

recursive, 86, 338 

passband of, 321, 511, 556-558 

stopband of, 321, 511, 556-558, 

567 

Final value theorem, 287-288, 593 
Finite impulse response, 559 
Finite precision representation, 585 
FIR, see finite impulse response 
FIR filters 

linear phase, 562 
Type 1 — 4, 562 
optimal, 618 

Forced response, 107, 424 
Fourier, Jean-Baptiste- Joseph, 152 
Fourier integral, 196 
Fourier series, 141-182 
dirichlet conditions for, 178 
exponential, 163-176 
Symmetry conditions in, 156—158 
trigonometric, 153-163 
Fourier spectra 

ofCTFT, 197,205-208 
of discrete-time Fourier series, 47 1 
of exponential CTFS, 167—169 
of DTFT, 478^179 
Fourier transform 

continuous-time, 193-251 

discrete-time, 475-517 

duality property of, 226-227 

existence of, 231—233, 482 

frequency-convolution property of, 227-230 

frequency-shifting property of, 222-223 

linearity, 216-219, 492 

numerical computation of, 247-250 

properties of, 491-505 

scaling property of, 219-220, 493 

short-time, 750 

table of, 217, 481 

time convolution property of, 227-230, 

498 

time differentiation property of, 224—225 
time integration property of, 225 
time shifting property of, 221-222, 493 
Frequency division multiplexing (FDM), 

369 

Frequency-differentiation property 
of DTFT, 497 
of z-transform, 588 


Frequency-domain analysis 

of continuous -time systems, 227-230, 
237-246 

of discrete-time systems, 498-502, 
506-514 

Frequency resolution, 542, 751, 759 
Frequency response, 245, 506, 606, 629 
Frequency sampling, 529 
Frequency shifting property 
ofCTFT, 222-223 
of DTFT, 495 
of DTFS, 504 

Frequency spectrum, 245, 471, 483 
Fundamental frequency, 10 

Gate function, 25, 208 
Generalized function, 255 
Gibbs phenomenon, 158, 593 

Hamming window, 594 
Hanning (Von Hann) window, 594 
Harmonic frequency, 13 
Heaviside, Oliver, 817 
Heaviside formula, 210, 817 
Hermitian Symmetry Property 
of DFT, 548 
of DTFS, 504 
of DTFT, 491 
Highpass filter, 556, 782 
design methods, 609, 706 
Homogeneity property, 73 

Ideal filter, 321-324, 556-559 
HR, see infinite impulse response 
Image, 773 
formats, 11 A 
spectral analysis, 775 
filtering, 779 
compression, 784 
Impulse function, 32-34, 426 
Impulse invariance method, 717-730 
Impulse response, 98, 103, 113-116, 427, 
556 

of ideal filters, 559, 565, 597, 600 
Infinite impulse response, 559 
Initial conditions, 64, 423, 594 
Initial value theorem, 287-288, 593 
Instantaneous frequency, 750 
Instantaneous (memoriless) systems, 83-84, 
127 

Integration table, 797-798 
Interpolation, 41^43, 399, 584 
zero-order hold, 407 
Inverse discrete Fourier transform, 531 
Inverse Fourier transform, 209-210, 477 
Inverse Laplace transform, 273—276 
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Inverse z-transform, 574 
partial fraction method, 575 
power series method, 580 

JPEG format, 421 

Laplace, Pierre-Simon, 262 
Laplace transform, 261-311 
bilateral, 262-266 
existence, 27 1 

frequency-convolution property of, 
284—287 

frequency- shifting property of, 
280-281 
inverse, 273-276 
linearity property of, 276-278 
region of convergence, 271, 295-298 
scaling property of, 278-279 
table of, 270 

time convolution property of, 284—287 
time differentiation property of, 
281-282 

time integration property of, 282-284 
time shifting property of, 279-280 
unilateral, 266-269 
Leakage, 543 
Left half plane (LHP), 301 
Legendre polynomials, 185 
L’Hopital’s rule, 797 
Linear phase, 562, 591 
Linear system, 73-79 
Linear time-invariant system, 103-137, 
423 

Linearity property 
of DTFT, 492, 505 
of DTFS, 492, 504 
of DFT, 549 
of z-transform, 582 
Lower sidebands, 371 
Lowpass filter, 556, 780 
designh methods, 599, 605 

Magnitude response, 508, 557 
Magnitude spectrum, 471, 483 
Main lobe, 595 

Marginally stable system, 302-303, 

604 

MATLAB, 831 

control statements, 840 
elementary operations, 842 
plotting functions, 844 
user interface, 853 
Maximally flat response, 324 
Mean, 753 

Mean square error, 788 
Memoryless system, 83-84, 127, 452 


Minmax optimization, 620 
Modulation, 66-67, 70-72, 369-373 
MP3 player, 421 

Multiplexing, frequency-division, 369 
Multipliers , 14—571 

Natural frequencies, 95, 344 
Natural response, 107, 424 
Noncausal signals, 31 
Noncausal system, 84—85, 93, 127, 136 
Nyquist sampling rate, 247, 397 

Odd function, 21-24 
Operators, differential, 106 
Orthogonal signal set, 142-149 
Orthogonal vector set, 142 
Orthogonality 

in complex signals, 143 
property, 465 
Orthonormal set, 144, 465 

Parks-McClellan algorithm, 621 
Parseval’s theorem 

for discrete Fourier transform, 550 
for Fourier series, 170-171, 184 
for Fourier transform, 230-231, 253 
for discrete-time Fourier series, 504 
for discrete-time Fourier transform, 503 
Partial fraction expansion 
for CTFT, 209-211, 824 
for DTFT, 500, 816, 827 
for Laplace transform, 273, 816-824 
for z-transform, 575, 828-830 
Passband of a filter, 320, 321-323, 556 
Period of a CT signal, 9-15 
Period of a DT signal, 9-15 
Periodic reflection, 442 
Periodic signal, continuous-time, 9-15 
Periodic signal, discrete-time, 9-15 
Periodicity property 
of DTFT, DTFS, 491 
of DFT, 548 
Periodogram, 754 
Phase response, 245-246, 351, 508 
Phase spectrum, 245-246, 351, 471, 483 
Picket fence effect, 543 
Picture element (pixel), 415 
Polar plot, 803 
Power spectral density, 753 
Poles, 294-295, 597, 612 
first-order, 817 
higher-order, 822 
Power Series, 796 
Power signals, 17-20 
Probabilistic signals, 20-21 
Pulse code modulation (PCM), 412 
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Quantization, 410-413 
uniform/nonuniform, 410 
error, 411 

Random signals, 20-21, 752 
spectral analysis, 758, 775 
Rectangular window, 593 
Recursive filter, 657 

Region of convergence, 263-266, 295-298, 
573 

Right half plane (PHP), 301 
Ripple Control parameter, 604 
Ripples, 593 
Round-off errors, 586 

Sampling rate (frequency), 247 
Sampling, 393 
interval, 395 
rate, 395, 397 
impulse-train, 395 
pulse-train, 405 
bandpass, 418 
sawtooth wave, 419 
theorem, 247, 397 

Scaling property, 126, 173-174, 219-220, 
278-279, 493 
Series summation, 796 
Shape control parameter, 604 
Shift operator, 57 1 
Sidebands, 371 
Sidelobes, 177, 595 
Short-time FT, 750 
Signals, 3 
analog, 8-9 
aperiodic, 9-15 
continuous-time, 6-8 
digital, 8-9 
discrete-time, 6—8 
energy, 16-20 
energy of, 16 

essential bandwidth of, 322 
periodic, 9-15 
power, 16—20 
power of, 16 

orthogonal representation of, 142-149 
Signum (sign) function, sgn(t), 25-27 
Sine function, 27-28 
Sinusoids, continuous-time, 10-11, 27, 
29-30 

Sinusoids, discrete-time, 11-12, 27 
Spectral estimation, 748 
Spectral folding, see aliasing 
Spectrogram, 752 
Spectrum 

magnitude, 167-169, 170-171 
phase, 245-246, 35 1 


Stability, 88-90 
analysis, 601, 453, 739 
bounded-input, bounded-output (BIBO), 
88-90, 128-130, 298-305, 601 
marginal, 302-304, 604 
Steady-state response, 107, 109, 137, 608 
Stopband, 320, 321-323, 556 
attenuation, 601 

Superposition principle, 73, 113 
Symmetry conditions in Fourier series, 
169-170 
Systems 

block-diagram of, 63, 307-311 
causal, 84-85, 93, 127, 452 
characteristic equation of, 107, 273, 294, 
346, 575 

classification of, 72-90 
continuous-time, 73 
control, 306, 368 
discrete-time, 73, 422 
dynamic, 83-84 
feedback, 308 
finite memory, 84 

frequency response of, 245, 506, 606, 629 
invertible, 130-131, 454 
linear, 73-79 

LTIC, 103 

LTID, 422 

marginally stable, 302-303, 604 
memory less, 83-84, 127, 452 
overdamped, 376 
realization of 

response to sinusoid input, 150-152, 
239-240 

stability, 88-90, 128, 298-305, 452 
time-domain analysis of, 103-137 
time-invariance, 79-83 
transform analysis of, 180-182, 237-246, 
305-307 

underdamped, 376 
unstable, 88-90, 128, 298-305 

Time-differencing property 
of DTFT, 496 
of DTFS, 504 
of z-transform, 587 
Time-differentiation property 
of CTFS, 174 
of CTFT, 224—225 
of Laplace transform, 281-282 
Time-domain analysis 

of continuous -time systems, 1 18-126 
of discrete-time systems, 422^-60 
Time integration property, 174, 225, 282-284 
Time-invariant system, 79-83 
Time inversion, 172 
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Time reversal property, 172 
Time scaling property 
of CTFS, 173 
of CTFT, 219-220 
of Laplace transform, 278-279 
of DTFT, 493 
of DTFS, 504 
of z-transform, 584 
Time shifting, 35-39 
Time shifting property 
of CTFS, 171 
of CTFT, 221-222 
of DFT, 549 
of DTFS, 504 
of DTFT, 493 

of Laplace transform, 279-280 
of z-transform, 585 
Time-summation property 
of DTFT, 498 
of DTFS, 504 
of z-transform, 592 

Transfer function, 181, 237—239, 285, 556, 596 
Transition bandwidth, 567, 595, 601 
normalized, 601 

Trigonometric Fourier series, 153-162 
Trigonometric identities, 795 

Underdamped system, 376 
Unilateral Laplace transform, 266-272 
Unilateral z-transform, 579 
Unit impulse function, 32-35 


Unit impulse response of a system, 113-116 
Unstable system, 88-90, 128-130, 298-305, 
453, 602 

Upsampling (interpolation), 41-44, 493 
Vectors, 142 

Width property of convolution, 126, 449 
Window function 

Bartlett/triangular, 594 
Blackman, 594 
Hamming, 594 
Hanning, 594 
Kaiser, 595, 603 
rectangular, 593 

Zero-input response, 106-1 1 1 , 424, 

809 

Zero-order hold, 407 
Zero-padding, 546 

Zero-state response, 106-1 11, 424, 812 
Zeros, 294-295, 597 
z-transform, 565 
bilateral, 567 
convolution property, 589 
inverse, 574 

shifting property of, 585 
linearity property of, 582 
region of convergence of, 573 
Table of, 572 
Unilateral, 569 



